Munich School of Robotics and Machine Intelligence

Munich School of Robotics and Machine Intelligence

Munich School of Robotics and Machine Intelligence

1 | | 2 Content

Foreword 4 Introduction 6

PART I Munich School of Robotics and Machine Intelligence 9 1 Mission Statement 10 2 MSRM: An Integrative Research Center of TUM 12 3 Research Focus at MSRM 14 4 Leadership and Boards 17 5 Lighthouse Initiatives 20 6 Highlights from two years of operations 24

PART II TUMs MSRM Community 29 1 Science Board 30 2 Community 42

Location and Contact 45 Acknowledgements 45 Imprint 47

3 | Foreword

Prof. Dr. Thomas F. Hofmann President of the Technical University of Munich

Never waste a crisis – this maxim of former U.S. President Barack Obama should be widely adopted. The corona pandemic defies the international community with transgressive challenges of historic proportions. The zero point has been re-calibrated and the future is being re-written. This global break exposes the weaknesses of the world, but it also reveals the potential for social change. The crisis offers a wide range of opportunities to strengthen Germany’s and Europe’s position as a hub for knowledge and business. However, achieving this will require several things: Unconditional courage for innovation in political decision-making, along with the agility and digital leadership of enterprises. Furthermore, an open- minded and responsible society as a solid foundation for a collaborative approach to innovation, together with the creative and transformational power of the world’s leading universities.

| 4 Munich School of Robotics and Machine Intelligence

Chartered with such a collaborative the top-level Industrial Advisory Board, mission, the Technical University of which is chaired by Prof. Edward G. Munich (TUM) founded the Munich Krubasik. The board brings along an School of Robotics and Machine overwhelming commitment and passion Intelligence (MSRM) in 2017. As an for taking MSRM to the next level. Integrative Research Center, the school is transcending all technical, departmental Almost three years have passed since and intellectual boundaries. MSRM, led MSRM’s day zero. Although MSRM is still by Prof. Sami Haddadin, has embarked in its infancy, a highly inspirational force on new paths to make machine-based field has been created. In the near future, assistance systems smarter and more this will be intellectually enriched by ad- responsive. To achieve this, gaps ditional research professorships and the between departments have been bridged. translational AI Mission Institute funded Now, the TUM’s leading competences by the Bavarian Government‘s Hightech as well as intellectual and financial Agenda. Despite the unprecedented toll resources from Informatics, Mechanical of the corona crisis, we can count on Engineering, Physics, and Electrical and massive political support as well as the Computer Engineering are connected. ongoing commitment of our strong indus- MSRM’s integrative research approach try and research partners. This combined combines artificial intelligence, robotics, effort presents us with the unique op- and perception. It is geared towards portunity to turn MSRM into the leading real-world applications in such areas as European center for responsible and re- the future of health, work, mobility and liable machine intelligence. Never waste the environment. This ambition has been a crisis! empowered by trustful strategic alliances with leading science and industry partners. In addition, it is supported by

5 | Introduction

Prof. Dr. Sami Haddadin Founding Director, Munich School of Robotics and Machine Intelligence

Cleary, artificial intelligence (AI) and ro- botics faced a technological quantum leap in recent years and made the multi- modal interaction of humans and machi- Copyright: David Ausserhofer nes possible, ranging from audiovisual to physical interaction.

With the recent and undoubtedly rapid developments in intelligent software and the wide range of emerging real-world ap- plications, the term artificial intelligence is today often associated and thus limited with its still rather early form of implemen- tation. With the anticipated advances e.g. in perception, collective intelligence and robotics, future research extends in an increasingly accelerated manner towards intelligent agents with an embodiment that purposefully interact with the physi-

| 6 Munich School of Robotics and Machine Intelligence

cal world. This evolution from purely di- of us will fundamentally transform our gital artificial intelligence to learning-en- society. Already today, many citizens abled cyber-physical systems will enable feel overwhelmed by the Internet and the humans to live their future everyday lives ubiquitous and seamless interaction via with a wide variety of assistive networked smart devices. Thus, and in particular in machines. times of vast progress and change, it is absolutely crucial for robotics and AI re- One could even say that the next gene- search to make sure we place the human ration of AI is embodied. This machine at the center of our research, technology intelligence – emerging from the scienti- development and translation. We must fic fields of robotics, artificial intelligence therefore ensure that the mission of our and perception – is the science of intel- research is to make people the main be- ligent, adaptive, and networked, artificial neficiaries of our work, both on a small systems that extend to the physical world and large scale. Cutting-edge technical and are able to purposefully interact with science in close cooperation with the so- humans and the environment. This evo- cial sciences and humanities can jointly lution in the relation of humans and ma- develop trustworthy and ethically accep- chines marks a revolutionary milestone ted key technologies that contribute to in technology development as both can solving the major challenges of our time. become true partners.

However, while this grand human-cen- tered vision is our goal, the breathtaking technical advances of the last decades and the presumed ones still lying ahead

7 | | 8 PART I

Munich School of Robotics and Machine Intelligence

9 | PART I

1 Mission Statement: New approaches to scientific and societal grand challenges

The Munich School of Robotics and democratization of physically embodied Machine Intelligence (MSRM) at the Artificial Intelligence (AI). Linking the Technical University of Munich (TUM) is interconnected digital world with the an integrative research center in the physical analog world with networked field of machine intelligence. Research intelligent machines, the MSRM explores and education at MSRM revolve synergistic interactions between people around the future advancement and and machines in everyday life.

| 10 Munich School of Robotics and Machine Intelligence

1 Mission Statement: New approaches to scientific and societal grand challenges

Finding answers to the grand societal that reaches far beyond the Munich Me- challenges of our time in the fields of en- tropolitan Region. With scientists from a vironment, work, health, and mobility is wide range of disciplines and the tight the driving force behind MSRM‘s research collaboration with institutions in the areas agenda. This agenda is aligned along stra- of philosophy, ethics and law, responsible tegic human-centered research mis- technology development and subsequent sions that aim to develop the reference integration into society are ensured. AI-algorithm and robot system platforms of tomorrow by tackling the underlying To meet the broad need for scientific and scientific grand challenges including the technical talent, MSRM will enable out- most complex real world scenarios. standing young researchers to engage in professional exchange at an interna- Being the crystallization point for re- tional level, empower them to carry out searchers across the TUM, MSRM will their own research agenda, and achieve a enable the strategic definition and execu- visible effect in the field. MSRM wants to tion of these long-term research missions. be the number one reference for teaching This mission-based research approach is and education in the design of integra- supported by aggregating a critical mass tive Robotics and AI study programs. of excellent researchers in large scale MSRM will thus develop a guiding vision lighthouse initiatives within research and coordinate education programs in sectors (robotics, AI, perception) and in- Robotics and Artificial Intelligence (MSc, novation sectors (work, health, mobility PhD, lifelong learning). and environment). The goal is to transla- te breakthrough research into real-world In cooperation with leading scientific ins- applications via field research. The mis- titutions and technology companies in the sion-based approach is nurtured and greater Munich area, the innovation hub enabled by bottom-up (“blue sky”) focus for robotics and artificial intelligence will groups that allow interdisciplinary teams be developed and strengthened. of scientists to team up pursuing high po- tential, fundamentally new approaches.

By creating a collaborative environment for the current world-class research and teaching at one of Europe’s leading uni- versities, MSRM aims to become a crys- tallization point for machine intelligence

11 | PART I

2 MSRM: An Integrative Research Center of TUM

The Technical University of Munich couple of years after its founding, MSRM (TUM) has founded the Munich School bundles ex­pertise­ across many facul- of Robotics and Machine Intelligence ties, including Aerospace and Geodesy, (MSRM) as a new Integrative Research Architecture, Electrical and Information Center (IRC). Such IRCs are formed to Engineering, Informatics, Education, Go- foster and empower mature interdiscipli- vernance, Mathematics, Medicine, Me- nary fields institutionally as a key player chanical Engineering, Physics, Sports in the new organization of TUM. Scien- and Health as well as Civil, Geo and En- tists from various TUM faculties and top vironmental Engineering. international researchers work together under one umbrella and across classical Clearly, MSRM does not only span across silos of disciplines. Already today, only a classical robotics and AI departments,

| 12 Munich School of Robotics and Machine Intelligence

2 MSRM: An Integrative Research Center of TUM

such as electrical engineering, computer chen, Deutsches Museum, Deutsches science and mechanical engineering, but Herzzentrum München, Fraunhofer Ge- builds bridges to machine intelligence sellschaft, DLR, fortiss, bidt, ...) and the collaborators of the future, such as phy- excellent national and international com- sics, chemistry, architectural/industrial munities in various dimensions of the design, life sciences, and health. TUM family.

MSRM synergizes this diverse expertise with the know-how of local cooperation partners from politics, society, industry, start-ups and the broader research com- munity (e.g. Helmholtz Zentrum Mün-

13 | PART I

3 Research Focus at MSRM

The focus of research at MSRM is the for- Research Sectors: mation and development of the interdis- AI, Perception, Robotics ciplinary scientific discipline of machine intelligence. The MSRM focuses on three “research sectors” and four defined “in- novation sectors”.

Accordingly, the MSRM is set up to form the discipline of machine intelligence along all relevant dimensions. From the nano to the meso to the macro scale, concepts of networking, interaction, le- arning and autonomy as well as system design and sensor technology are ex- plored from basic science to real-world application. Through the synergistic use Machine Intelligence is the science of MSRM competencies, scientific and of exploring intelligent, adaptive and technological progress is made in so- networked, potentially hybrid artificial cietal, industrial and medical applicati- systems that act, react and interact on domains. For example, adaptive and with people and the environment in a networked robot assistants are being purposeful manner in the physical world. developed for the future industry, autono- It emerges from the fields of robotics, mously flying and driving robot teams are artificial intelligence and perception and being advanced as part of future mobility a set of application domains. and medical nanobots and intelligent la- boratories are being developed for future In addition to classical robotics and ma- healthcare applications. Thus, the MSRM chine intelligence-related disciplines, such achieves socially exploitable research re- as electrical engineering and informati- sults, which are expanded into so-called on technology, mechanical engineering flagship initiatives for successful applica- or computer science, these application tion fields. domains also include areas such as phy- sics and chemistry, architecture / industrial design, or life sciences and health.

| 14 Munich School of Robotics and Machine Intelligence

Innovation Sectors: (1) The Future of Health: Enhancing the Health, Mobility, Work, Environment healthcare system by creating inclusive, smart medical and nursing services with The MSRM’s research strategy is purpo- improved quality for a more independent se driven. The so-called MSRM „innova- lifestyle, especially for the elderly, whi- tion sectors“ revolve around the mission le respecting privacy and cybersecurity to create application-oriented machine issues (including security by design and intelligence and robotics for our future data integrity). The goal is to create the society. They build the bridge between future AI- and Robotics-supported hospi- groundbreaking AI and robotics systems tal and nursing home for inclusive optimal developed in the research sectors and medical care, independent living for the their ability to answer the societal needs elderly and personalized medicine. of our time. The four underlying societal missions are as follows:

15 | PART I

(2) The Future of Work: Ending inhu- (4) The Future of Environment: Helping mane working conditions through intelli- to protect our natural resources and the gent and self-repairing infrastructure that planet on which we and future genera- supports productivity and performance tions live by creating energy-aware/-effi- for agile production and construction si- cient AI and Robotics that help mitigate tes with easy, integrated maintenance. climate change and environmental de- The goal is to create the future AI- and gradation, e.g. for a sustainable and re- Robotics-supported self-repairing col- source-efficient food agriculture system laborative infrastructure, manufacturing while taking environmental conservation and construction site that enables hu- into consideration. man-centered and efficient operation as well as flexible production.

(3) The Future of Mobility: Laying the foundations to the “Future of Work” and “Future of Health” missions by creating AI- and Robotics-supported sustainab- le mobility solutions tailored to different regional needs through electrifying, auto- mating and interconnecting future trans- portation systems for safe and improved travel. This also includes redesigned mo- bility spaces and holistic mobility con- cepts for high-density urban areas as well as novel approaches for reaching remo- te and potentially dangerous locations, enabling physical on-site interaction th- rough the use of supervised teleoperated mobile robot teams (e.g. for infrastructure maintenance).

| 16 Munich School of Robotics and Machine Intelligence

4 Leadership and Boards

The science, innovation, cooperation MSRM Ambassadors complement the and education strategy of MSRM is de- Science Board, forming a link to neigh- veloped by the MSRM Science Board. bouring disciplines, the wider scientific community, industry and (inter)national MSRM is advised by a scientific advisory politics. board (SAB) and an industry advisory board (IAB) with renowned external experts. 4.2 Science Advisory Board

4.1 Science Board The SAB, which is currently being esta- blished, advises on the research orien- The Research and Innovation Leaders of tation of MSRM in terms of constructive the MSRM Science Board are responsib- support and develops recommendations le for the further development of the sec- for the strategic and organizational de- tor strategy and the setting of thematic velopment of MSRM. In addition, it as- priorities. The Education Leaders are re- sesses the quality assurance in research. sponsible for teaching and programmes The new SAB will be announced to promote young talent. at munich_i during automatica in December 2020.

Cremers Diepold Steinbach Lüth Burschka Cheng

Haddadin

Bengler Vogel-Heuser Knoll Hemmert Navab Lienkamp

Franklin Rixen

Hirzinger Lüth Buyx Knoll Dietz Cremers GER Politics Industry Healthcare EU Politics & Network Research & Network

17 | PART I

4.3 Industrial Advisory Board

Besides maximum scientific excellence, the MSRM aims for effective and high- level knowledge as well as technology transfer across the entire value chain. MSRM has therefore established the MSRM Industrial Advisory Board (IAB) and is proud to have high-level representatives of internationally leading Krubasik technology companies and institutions as members. Its Chairman is Prof. Dr. Edward G. Krubasik, an experienced former Member of the Siemens Management Board.

Ploss Schardt Saueressig Matschi Spath Bishop

Schuster Gaus Hirzinger Hoke Curioni

| 18 Munich School of Robotics and Machine Intelligence

Chairman: Helmut Matschi Prof. Dr. Edward G. Krubasik Member of the Executive Board, Previous Member Corporate President Vehicle Networking and Executive Committee, Siemens Information, Continental Dr. Reinhard Ploss Prof. Christopher Bishop, FREng FRS CEO, Infineon Technical Fellow and Lab Director, Thomas Saueressig Microsoft Research Cambridge Member of the Executive Board and Dr. Alessandro Curioni Leader of the Board area SAP VP Europe, Director IBM Research – Product Engineering, SAP Zurich Research Laboratory IBM Dr. Peter Schardt Dr. Norbert Gaus CTO, Siemens Healthineers Executive VP Head of Research and Dr. Gerd Schuster Development in Digitalization and Senior Vice President Research, New Automation, Siemens Technologies and Innovations, BMW Prof. Dr. Gerd Hirzinger Prof. Dr. Dieter Spath Director Emeritus, DLR Robotics and President acatech – National Mechatronics Center Academy of Science and Engineering Dirk Hoke CEO, Airbus Defense & Space

With the aim of providing mutual benefit to the MSRM and the industry partners, the IAB advises and supports MSRM along four pillars.

19 | PART I

5 Lighthouse Initiatives

A major goal of the MSRM is to achieve research results from their application do- societal exploitable research results mains into immediate use. The first three through effective collaboration within its lighthouse initiatives are: application domains. Interdisciplinary groups of researchers will gather in focus • Geriatronics groups to pursue innovative ideas and • Human-Robot-Collective (AI.Factory) concepts from fundamental to applied • Autonomous Robot Teams research. These initiatives are already underway Within supplementary lighthouse initiati- or currently being planned within the ves, new technologies developed by the MSRM. Leading the way the Geriatronics MSRM will be implemented, developed lighthouse initiative has been established further by companies and tested by end- in the Geriatronics Research Center at users. Testing and validating these new Garmisch-Partenkirchen in early 2019. technologies in the real world will bring

1. Geriatronics (execution phase) Robot assistants for self-determined living in old age.

2. Human-Robot Collective (planning phase) 100 workers use 1,000 robots to master 1 million new tasks every day.

3. Autonomous Robot Teams (concept phase) Moving and operating safely on land, in air and through water.

| 20 Munich School of Robotics and Machine Intelligence

Lighthouse Initiative Geriatronics

The lighthouse initiative ‚Ge- riatronics – Robot Assistants for the Elderly‘, is driven by a team of young researchers that work closely together with seniors and elderly people to enable long-term self-determined living.

Geriatronics is a new term to describe the interplay of robotics, mechatronics, in- formation technology, ma- chine intelligence and 3D technology in combination with geriatrics, gerontolo- gy and nursing. The aim of this research is to enable the elderly to telligent assistance robotics systems for maintain mobility for as long as possible a self-determined life and maintaining and to facilitate interpersonal interaction mobility in old age. An example of the in- and communication. Intuitively operable itiatives are the planned trial apartments, assistance systems adapt directly to the where seniors can experience the sup- user and thus enable independence in old port offered in a living space equipped age and in case of illness. Another central with Geriatronics technology. goal of geriatronics is to relieve the strain on nursing staff in their everyday lives. In summary, this lighthouse initiative sees Support in physically stressful situations itself as a supporter and companion of el- is intended to improve the general wor- derly people and care facilities in overco- king situation in the nursing area. ming ever new challenges in everyday life. The aim is to develop Garmisch-Parten- kirchen into a model community of in-

21 | PART I

Geriatronics – Statements

Dr. Markus Söder Bavarian Minister-President “We live in an age in which technology is rapidly chan- ging the world. One example of what we can achieve with Geriatronics is to enable peo- ple to take care of themselves

Andreas Heddergott / TUM Heddergott Copyright: Andreas independently and go about their daily lives despite physical affliction. A person affec- ted in this manner does not ask philosophical questions about artificial intelligence, but rather wants to know how it can help him or her.”

Ilse Aigner, MdL President of the Bavarian State Parliament “We all wish to live a self-determined life into old age. At the Geriatronics Research Center in Garmisch-Parten- kirchen, intelligent assistive robotics systems are being developed for elderly people that will ease and support the process of caring for the elderly in the future. This is innovative and trendsetting. This is what Bavaria needs.”

| 22 Munich School of Robotics and Machine Intelligence

Elisabeth Koch First Mayoress Markt Garmisch-Partenkirchen “Geriatronics in Garmisch-Partenkirchen has been a pas- sion project for me from the very first second. The inno- vative and forward-looking technology being worked on in the new Geriatronics Research Center of the Technical University of Munich offers new prospects for life, not

Copyright: Susie Knoll only for our older population. It is also the key to success- fully shaping the educational and corporate structure in the entire district.”

Prof. Dr. Wolfgang M. Heckl President Friends of Geriatronics, Director Deutsches Museum and Chair for Scientific Communication, TU Munich “The Geriatronics Research Center is one of the most important and forward-looking developments in the Alp- spitze region. The cooperation of the numerous partners of this lighthouse project – Leifheit Foundation, GaPa community, Deutsches Museum, educational- social and health care institutions – will make it even more important and known.”

23 | PART I

6 Highlights from two years of operations

Two years of creating a „Culture of · IEEE/ACM William J. McCalla Excellence“ at MSRM. ICCAD Best Paper Award (2012), In 2020, two years after its founding, the · the Georges Giralt PhD Award MSRM has proven its excellence with the (2019, 2012), following progress and visible benefits for · IEEE Worldhaptics Conference TUM and the science location Munich/ Best paper award (2009, 2019), Bavaria. · and many more… (3) MSRM brings together numerous (1) The MSRM, as an Integrative Rese- – affiliated PIs which have received arch Center (IRC), has succeeded in a series of important fellow- and bringing together over 80 Principal memberships during their careers, Investigators (PIs) and experts of among them e.g. (this listing does TUM in the seven sectors: Percep- not claim to be exhaustive): tion, Robotics, AI, Future of Work, · 2 memberships at acatech – the Future of Health, Future of Mobility German Academy of Science and and most recently Future of Environ- Engineering (since 2010 and 2020), ment. · 1 IEEE senior fellowship (2020), (2) MSRM brings together numerous · 2 IEEE fellowships (2017, 2015), PIs which have received a series · several Emmy-Noether-Fellow- of important (inter-)national awards ships for young scientists of the during their careers, among them DFG, e.g. (this listing does not claim to be · and many more… exhaustive): (4) The MSRM is contributing to the ex- · 7 ERC Starting Grants, 6 ERC pansion of TUM through a Geriatro- Consolidator Grants and 3 ERC nics lighthouse project and research Advanced Grants center, which are currently being ex- · 3 Gottfried Wilhelm Leibniz prizes panded to a model community and of the DFG (2019, 2016, 2015), TUM campus in Garmisch-Parten- · the German Future Prize by kirchen. Germany‘s Federal President (5) The MSRM was highly involved in (2017), strengthening TUM with new AI pro- · the Helmholtz Professorship prize (2015), · IEEE/RAS Early Career Award (2015),

| 24 Munich School of Robotics and Machine Intelligence

fessorships. Approximately 8 out of our efforts in the area of „Future of the 11 AI professorships allotted to Health“. TUM from the Bavarian AI Initiative (9) The MSRM is helping to strengthen are affiliated with the MSRM. Addi- Bavaria as a leader in science and tionally, one of the three AI profes- innovation: our ideas and concepts sorships that TUM won in the Bava- contributed to the Bavarian High- rian AI Competition was submitted tech Strategy (2 Bn. Euro), which by the MSRM. Moreover, the MSRM the Bavarian Minister-President an- has been awarded two new profes- nounced at TUM in Garching in Fe- sorships from the Bavarian State bruary 2020. budget. (10) The MSRM has been selected to (6) The MSRM created a network of become the nucleus of the Bavarian over 800 European PIs in intelligent “AI Mission Institute”, which links re- robotics to propose the joint CEN- search and entrepreneurial AI activi- TRIS research network of excellen- ties via mission-based, purpose-led ce for Horizon 2020. Although the research and emphases the transfer proposal will not be funded by the of knowledge into application. European Commission, the network (11) The MSRM is recognized for „Best will continue to cooperate and is Practice“: Project KoBo34, in which currently under reformation. a humanoid service robot for the (7) The MSRM has created a health elderly is being developed and tes- network through large-scale initiati- ted, was presented by the Federal ves of the innovation sector “Future Ministry of Education and Research of Health” with important clinical at conferences as a model in the partners such as the TUM Universi- field of requirement analysis and ty Hospital rechts der Isar (MRI), the acceptance studies (“participatory BG Hospital Murnau (BGU), Helm- development”). holtz and the German Heart Center Munich (DHM). (8) The MSRM sector “Future of Health” created a cooperative project „Digi- tal Operating Room“ with the Ger- man Heart Center Munich (DHM). Under the leadership of MSRM, this initiative of the Bavarian Minis- ter-President Söder will strengthen

25 | PART I

(12) The MSRM creates visibility for telligence (European level) and the excellent research: automatica, the Enquete Commission on Artificial In- world’s leading trade fair for smart telligence of the German Bundestag. automation and robotics, has offe- Here, MSRM helped to shape the red the MSRM, as well as its industry basic definition for a European AI. and research community, the oppor- (14) The MSRM is helping to develop tunity to shine. We have been ent- the „Munich Manifesto“ in the focus rusted with designing the munich_i group „Ethics Embodied AI“. We are Summit and the AI.Society special advocating trustworthy intelligent exhibition at automatica 2020 pro- machines and are strongly connec- vided with over 1,000 m2 exhibition ted to the German Ethics Council, space. The expo is now shifted from as the Chairperson is affiliated with June to December 2020. the MSRM. (13) The MSRM is represented in high-le- (15) The MSRM organised the „Jugend vel expert groups, including the High Forscht“ regional competition for Level Expert Group on Artificial In- Munich West for the first time at

Visit Chancellor Merkel @Heßstraße

Health@MSRM Mobility@MSRM Kickoff HDT MCube Project Mobility@MSRM 1. IAB Meeting Focus Group Proposal Roborace Season Alpha

May 18 Jun 18 Jul 18 Aug 18 Sep 18 Oct 18 Nov 18 Dec 18 Jan 19 Feb 19 Mar 19 Apr 19 May 19

Handover 2. IAB Meeting 3. IAB Meeting – Building Focus Mobility@MSRM Heßstraße Opening Gala & Scientific Symposium Publication EC @Pinakothek der Moderne „Ethics Guidelines for trustworthy AI“

| 26 Munich School of Robotics and Machine Intelligence

TUM. We are thus promoting the AI with world-class talents: The ad next generation of STEM, robotics hoc advisory committee „Robotics and AI talents. and Machine Intelligence“, to which (16) The MSRM is developing a joint several MSRM PIs contribute, has MSRM education strategy to of- started the recruitment process to fill fer a world-class, international and new Humboldt Professorships with multi-disciplinary study program at excellent international candidates. TUM. (19) The MSRM is promoting collabo- (17) First interdisciplinary initiatives were ration between TUM and internati- founded: The successful focus onal top universities by new strate- group „Human Digital Twin“ (Future gic partnerships with the Eurotech of Health) is now applying for a pres- Alliance and with Imperial College tigious research training grant from London, and more to come. the German Research Foundation. (18) The MSRM is committed to expan- ding TUM in the area of robotics and

„Jugend forscht“ Regional Competition Mobility@MSRM @MSRM Visit Minister Sibler

4. IAB Meeting – 6. IAB Meeting – Focus Work Work@MSRM Start Work@MSRM Focus Perception @MSRM Summer School Cooperation General Assembly @MSRM automatica

Jun 19 Jul 19 Aug 19 Sep 19 Oct 19 Nov 19 Dec 19 Jan 20 Feb 20 Mar 20 Apr 20 May 20 Jun 20

5. IAB Meeting – Hightech Summit Mobility@MSRM Focus Health Roadshow @MSRM Autonomous Driving Health@MSRM AMSEM Graduiertenkolleg initiated Announcement of KI Announcement TUM Mission Institute „Geriatronik-Campus“ @MSRM in Hightech Agenda Garmisch-P.

27 | | 28 PART II

TUMs MSRM Community

29 | PART II

1 Science Board

Prof. Dr. phil. Klaus Bengler Work Klaus Bengler graduated in psychology at the University of Regensburg in 1991 and received his Doctorate in 1994 in cooperation with BMW. After his diploma he was active on topics of software ergonomics and evaluation of human-machine interfaces. He investigated the influence of additional tasks on

Copyright: TUM driving performance in several studies within EMMIS EU project and in contract with BMW. Multifunctional steering wheels, touchscreens and ACC-functionality are examples for the topics of these investigation. In 1997 he joined BMW. From several projects he is experienced with experimental knowledge and experience with different kind of driving simulators and field trials. At BMW he was responsible for the HMI project of the MOTIV programm a national follow on programm of PROMETHEUS. He was work package leader in an actual EU project Speechdat Car, dealing with voice recognition in vehicles. Within BMW Research and Technology he was responsible for projects on HMI research. He was active as a subprojectleader for subproject 2 “Evaluation und Methodology” within the EU-funded integrated project AIDE. He is active member of ISO TC22 SC13 WG8 „Road vehicles – Ergonomic aspects of transport information and control systems“ and chairman of the German delegation. Since May 2009 he is leader of the Institute of Ergonomics at Technical University Munich which is active in research areas like digital human modeling, human robot cooperation, driver assistance, automated driving and human reliability. Among intensive industrial cooperation the Institute is engaged in the funded Projects DH-Ergo on Digital Human Modeling and ECOMOVE on anticipative driving and H-Mode or D3COS on highly automated and cooperative driving. He is project leader in the German research initiative UR:BAN that investigates the potential of driver assistance and active safety systems in the urban area.

| 30 TUMs MSRM Community

Prof. Dr.-Ing. Darius Burschka Robotics Prof. Burschka (b. 1966) conducts research into sensor systems in robotics and human-machine interfaces. Video-based navigation is one of his particular interests. This involves simulation of complex sensor systems through the analysis and fusion of sensor properties of physical sensor units and 3D reconstruction

Copyright: TUM from the fusion of multimodal sensor data. After completing his studies in electrical engineering and his doctorate (1998) at TUM, Prof. Burschka became a postdoctoral researcher at Yale University, New Haven, USA. There, he made advancements in the development of laser-based map generation and position tracking. After that, he worked as an associate research scientist at Johns Hopkins University, Baltimore, USA. His research topic was sensor-based navigation and 3D reconstruction (1999-2005). He was appointed assistant research professor at the university in 2003. Since 2005, Prof. Burschka has held the position of associate professor of robotics and embedded systems at TUM. He works closely with the Institute for Robotics and Mechatronics of the German Aerospace Center (DLR) in Oberpfaffenhofen.

Prof. Dr. Gordon Cheng Perception Professor Cheng (b. 1968) researches the fundamental understanding and construction of cognitive systems. He studies ways to combine widely diverse capabilities in multipurpose high-performance robots and develops natural communication mechanisms in order to improve the application

Copyright: TUM friendliness of robots. Professor Cheng studied information sciences at Wollongong University (Australia) and was awarded a doctorate in systems engineering in 2001 at the department of systems engineering of the Australian National University. He founded the department of humanoid robotics and computational neuroscience at the

31 | PART II

Institute for Advanced Telecommunications Research in Kyoto (Japan), where he was Department Head from 2003 to 2008. In addition, from 2007 to 2008 he was a project manager at the National Institute of Information and Communications Technology (Japan) and the Japan Science and Technology Agency, where he was responsible for the Computational Brain project (2004-2008). Since 2010, Professor Cheng has been conducting research and teaching at TUM as a full professor of cognitive systems. He is coordinator of the Center of Competence Neuro-Engineering in the Department of Electrical and Computer Engineering and speaker of the newly established Elite Master of Science program in Neuroengineering (MSNE) of the Elite Network of Bavaria.

Prof. Dr. Daniel Cremers Artificial Intelligence Daniel Cremers studied physics and mathematics in Heidelberg, Indiana and New York. He received a PhD in Computer Science (2002) from the University of Mannheim, Germany. Subsequently he spent two years as a postdoctoral researcher at the University of California at Los Angeles (UCLA) and one year as a permanent

Copyright: Eckert/ Heddergott, TUM Copyright: Eckert/ Heddergott, researcher at Siemens Corporate Research in Princeton, NJ. From 2005 until 2009 he was associate professor at the Univer- sity of Bonn. Since 2009 he holds the Chair of Computer Vision and Artificial Intelligence at the Technical University of Munich. His publications received numerous awards, including the ‚Best Paper of the Year 2003‘ (Int. Pattern Recognition Society), the ‚Olympus Award 2004‘ (German Soc. for Pattern Recognition) and the ‚2005 UCLA Chancellor‘s Award for Postdoctoral Rese- arch‘. For pioneering research he received five grants from the European Research Council, including a Starting Grant (2009), a Consolidator Grant (2015) and an Advanced Grant (2020). Pro- fessor Cremers has served as associate editor for several jour- nals. In 2018 he organized the largest ever European Conference on Computer Vision in Munich with over 3300 delegates. He is

| 32 TUMs MSRM Community

member of the Bavarian Academy of Sciences and Humanities. He is honorary member of the Dagstuhl Scientific Directorate. In December 2010 he was listed among „Germany‘s top 40 rese- archers below 40“ (Capital). On March 1st 2016, Prof. Cremers received the Gottfried Wilhelm Leibniz Award, the biggest award in German academia. He is co-founder of several companies, most recently the high-tech startup Artisense.

Prof. Dr.-Ing. Klaus Diepold Artificial Intelligence Professor Diepold (b. 1961) conducted research in the field of multimedia signal processing with a focus on the design of fast algorithms. Today, he concentrates on machine learning, Astrid Eckert / TUM which entails developing moral machines as well as modeling and simulating effects for cognitive systems. He is also

Copyright: actively involved in entrepreneurship training for students from all departments at the Center for Digital Technology and Management (CDTM) and promotes entrepreneurship within his own department. After studying electrical engineering and information technology and completing his PhD (1992) at TUM, Professor Diepold developed video compression systems and MPEG standards (MPEG-4, MPEG-A) in industry. In 2002, he accepted the Chair of Data Processing at TUM, where he served as Dean of Studies from 2005–10. Visiting professorships took him to Alberta, Canada and NICTA, Australia. Prof. Diepold is a member of CDTM’s supervisory board and was on the board of management of the cluster of excellence Cognition for Technical Systems (CoTeSys) from 2006-14. From 2013–15, Professor Diepold served as TUM‘s Senior Vice President for Diversity and Talent Management. In 2018, the web video series “Technically Single” which he had initiated aired nationwide.

33 | PART II

Prof. Dr. David Franklin Education Prof. David Franklin investigates the physiological and computa- tional principles of human neuromuscular motor control. His re- search examines how the nervous system controls the mechani- cal properties of the body to adapt to our external environment and produce skilful movement. To examine the computations

Copyright: Astrid Eckert, TUM underlying sensorimotor control, he blends computational and experimental approaches including robotics and virtual reality. Prof. Franklin studied human physiology and was awarded a doctorate in neuroscience in 2005 from the Department of Ki- nesiology at Simon Fraser University (Canada). He worked as a researcher at the Institute for Advanced Telecommunications Research (Kyoto, Japan) from 1999 to 2006. He then spent 3 years as a research associate in the Department of Engineering at the University of Cambridge (U.K.). In 2010 he was awarded a Wellcome Trust RCD Fellowship and became a research fel- low at the University of Cambridge. He has been an associate professor of Neuromuscular Diagnostics at TUM since 2016.

Prof. Dr. Sami Haddadin Founding Director Prof. Sami Haddadin is Director of the Munich School of Robotics and Machine Intelligence at the Technical University of Munich (TUM) and holds the Chair of Robotics and System Intelligence. Prof. Haddadin was Chair of the Institute of Automatic Control at Gottfried Wilhelm Leibniz Universität Hannover from 2014 to 2018.

Copyright: David Ausserhofer Prior to that, he held various positions as a researcher at DLR. He holds degrees in electrical engineering, computer science and technology management from the Technical University of Munich and the Ludwig Maximilian University of Munich. He received his PhD summa cum laude from RWTH Aachen University. He has published more than 200 scientific articles in international journals and conferences. He has received numerous national and international awards for his scientific work, including the

| 34 TUMs MSRM Community

Alfried Krupp Award for Young Professors (2015), the German Future Prize of the Federal President (2017) and the Leibniz Prize (2019). He is a member of the national academy of technical sciences acatech. He is a member of the Enquete commission AI of the German Parliament and the High-Level Expert Group on AI of the European Commission. Prof. Haddadin is the founder of Franka Emika GmbH (Munich, 2016). During his time as at DLR, he played a major role in the development of the lightweight robot technology, which became the KUKA LBR iiwa in technology transfer.

Prof. Dr.-Ing. Werner Hemmert Health As part of his research activities, Prof. Hemmert (b. 1964) explores the principles of information processing in the auditory system. Through his work, he develops novel approaches for the advancement of neuroprosthetics. His research is characterized by a combination of theoretical concepts and experiments and

Eckert/Heddergott, TUM Copyright: Eckert/Heddergott, he relies on close collaboration with workgroups from the fields of biology and medicine as well as industry representatives. After studying Electrical and Computer Engineering at TUM, he went to work at the Tübingen Hearing Research Center (1991- 1998). During that time, he studied the micromechanics of the inner ear, which was the basis for his doctorate, which he received from Ruhr-Universität Bochum in 1997. After that, he conducted research at the Massachusetts Institute of Technology (1998-2000), IBM Research – Zurich (2000-2001) and Infineon Technologies, Corporate Research (2001-2007). Prof. Hemmert is a member of the German Acoustical Society (DEGA), the Association for Research in Otolaryngology and the Graduate School of Systemic Neurosciences. He is also a senior member of the IEEE.

35 | PART II

Prof. Dr.-Ing. Alois Knoll Mobility Prof. Alois C. Knoll is a German computer scientist and has been professor at the Faculty of Computer Science at the Technical University of Munich since 2001. He teaches and conducts research in the fields of autonomous systems, robotics and artificial intelligence.

Eckert/Heddergott, TUM Copyright: Eckert/Heddergott, Between 2007 and 2009, he was a member of the EU‘s highest advisory board for information technology ISTAG. He was involved in the development of the EU flagship projects, and was one of the authors of the report “European Challenges and Flagships 2020 and Beyond”. In 2009, he co-founded “fortiss”, the Munich Institute for Software and Systems, which, due to its success, has since been transformed into a state institute of the State of Bavaria. He coordinated the EU project ECHORD++, a major initiative with the aim of bringing new robot technology to market maturity. Since 2013, he has been head of the sub-project “Neurorobotics” of the Human Brain Project. Since 2015, he has been director of software development, i.e., one of three scientific directors of the HBP. He is a senior member of the IEEE, a member of the German Society of Informatics and a Fellow of the School of Engineering of the University of Tokyo (2010).

Prof. Dr.-Ing. Markus Lienkamp Mobility Prof. Lienkamp (b. 1967) researches and teaches in the following areas: electromobility with the aim of developing new vehicle concepts, driver assistance systems and automated driving, as well as mobility data and mobility concepts. He is Director of Research at TUM’s Munich School of Engineering, the Science Center for Electromobility and the CREATE project in Singapore. Copyright: TUM After studying mechanical engineering at TU Darmstadt and Cornell University, Prof. Lienkamp did his doctorate at

| 36 TUMs MSRM Community

TU Darmstadt (1995). He worked at Volkswagen as part of an international trainee program and played a role in a joint venture between Ford and Volkswagen in Portugal. Returning to Germany, he led the brake testing department in the VW commercial vehicle development section in Wolfsburg. He later became head of the “Electronics and Vehicle” research department in Volkswagen AG’s Group Research division. One of his main priorities there was developing vehicle concepts for electromobility. Prof. Lienkamp started lecturing at TUM’s Chair of Automotive Technology in November 2009.

Prof. Dr. Tim Lüth Robotics Professor Lüth studied electrical engineering at Darmstadt Uni- versity of Technology until 1989. In 1993, he obtained his docto- rate at the University of Karlsruhe with a thesis on robot manu- facture. In 1994/1995, he was visiting professor at the Japanese robotics research institute ETL of MITI-AIST. He completed his

Kuratorium Wohnen im Copyright: Kuratorium Wohnen München) Alter (KWA lecturer qualification in computer science at the University of Karlsruhe in 1997. In the same year, he was appointed associate professor of clinical navigation and robotics at the Charité institu- te of Humboldt University Berlin. In 2001, he became a full profes- sor in Berlin and received the newly created Chair of Mechatronic Medical Technology, an institute jointly organized by Charité and the Fraunhofer Society. In 2005, Prof. Lüth was appointed full professor at TUM at the Chair of Micro Technology and Medical Device Technology. Tim Lüth was appointed Adjunct Professor at the University of Toronto in 2007 and was nominated as one of the top 3 inventors in the Lifetime Achievements category of the European Patent Office in 2007. He was elected to the National Academy of Science and Engineering acatech in 2010 and to the Scientific Advisory Board of the Alfried Krupp Foundation (main shareholder of Tyssen-Krupp AG) in 2017. Since 2018 he is a

37 | PART II

Fellow of the University of Tokyo. Tim Lüth himself has been a founder and shareholder of high-tech companies for more than 30 years and is author and coauthor of about 350 publicatins in the field of robotics, medical devices and 3D printing.

Prof. Dr. Nassir Navab Health Prof. Nassir NAVAB is a full Professor and Director of the Laboratory for Computer Aided Medical Procedures, Technical University of Munich. He also has secondary faculty appointments at TUM’s Medical Schools. He is also a part time (20%) research professor at Johns Hopkins University with secondary affiliation

Copyright: Nassir Navab to its medical school. Nassir is the author of hundreds of peer reviewed scientific papers, with more than 32600 citations and an h-index of 84 as of June 15, 2020. He completed his PhD at INRIA and University of Paris XI, France, and enjoyed two years of post-doctoral fellowship at MIT Media Laboratory before joining Siemens Corporate Research (SCR) in 1994. At SCR, he was a distinguished member and received the Siemens Inventor of the Year Award in 2001 before joining TUM in October 2003. He received the SMIT Society Technology award in 2010 and the ‘10 years lasting impact award’ of IEEE ISMAR in 2015. In 2012, he was elected as a Fellow of the MICCAI Society. He has acted as a member of the board of directors of the MICCAI Society, 2007- 2012 and 2014-2017, and serves on the Steering committee of the IEEE Symposium on Mixed and Augmented Reality (ISMAR) and Information Processing in Computer Assisted Interventions (IPACI). He is author of more than thirty awarded papers including 11 at MICCAI and 3 at IEEE ISMAR. He is the inventor of 49 granted US patents and more than 50 international ones. His current research interests include medical robotics, machine learning, augmented reality, multimodal imaging and computer- assisted interventions.

| 38 TUMs MSRM Community

Prof. Dr. Daniel J. Rixen Education Professor Rixen has worked for more than twenty five years on theoretical, numerical and experimental aspects of the dynamics of structures and systems. His activities encompass simulations and measurements of vibrations as well as domain decomposi- tion for parallel computing, modelling of multiphysical systems

Copyright: TUM and model reduction techniques. Since 2012, he is also heavily involved in the planning and control of robots and mechatronical systems. Developments are pursued in collaboration with aca- demic partners and industry in domains such as aeronautics and aerospace, automotive, mechatronics, wind energy, microsys- tems or medical instruments. Professor Rixen, (b. 1967) received his engineering degree (elec- tro-mechanics) from the University of Liège (ULg, Belgium) and an MSc degree in Aerospace Vehicle Design from the College of Aeronautics in Cranfield (UK). He obtained his doctorate degree from ULg in 1997. After a research assistantship at the Center for Aerospace of the University of Colorado (USA), in 2000 he became a full professor at Delft University of Technology (The Netherlands) where he held the Chair of Engineering Dynamics. Since 2012, he has served as the head of the Chair for Applied Mechanics at the School of Engineering and Design of TUM.

Prof. Dr.-Ing. Eckehard Steinbach Perception Professor Steinbach (b. 1969) and his team research fundamental methods for and applications of audio-visual-haptic information processing and transmission. The current focus of his activities are mobile multimedia communication, haptic data compression, indoor localization, and machine learning-based analysis of

Copyright: TUM visual and haptic information. After studying electrical engineering at the University of Karlsruhe, the University of Essex and ESIEE in Paris, he was awarded a doctorate in 1999 at Friedrich-Alexander University

39 | PART II

of Erlangen-Nuremberg. From 2000 to 2002, he conducted research at Stanford University, initially as a post-doc and later as a consulting assistant professor. In 2002, he was appointed to the position of associate professor of Media Technology at TUM. Since 2009, he has held the Chair of Media Technology there. As the Dean of Studies of the Department of Electrical and Computer Engineering, he is responsible for the study programs of his department. Professor Steinbach is a Fellow of the IEEE.

Prof. Dr.-Ing. Birgit Vogel-Heuser Work Prof. Vogel-Heuser‘s (b. 1961) main research interests are systems and software engineering and modeling of distributed, reliable embedded systems. Her research focuses on the challenges resulting from increasing demand to produce customer-specific products in the plant manufacturing domain. Her other research

Copyright: Sebastian Ulewicz/ Lehrstuhl AIS interests include engineering and education of hybrid processes and heterogeneous distributed and intelligent systems as well as machine-learning algorithms using a human-centered approach where the whole life cycle of products and production lines is considered.” Prof. Vogel-Heuser received her Dipl.-Ing. degree in electrical engineering in 1987 and her Dr.-Ing. degree in mechanical engineering in 1990 from the RWTH Aachen, Germany. She acquired industrial experience over ten years, including a position as manufacturing director for the Siempelkamp Group. After various professorship positions in Hagen, Wuppertal, and Kassel, she was appointed to the Chair of Automation and Information Systems at TUM in 2009. She was speaker of the DFG Collaborative Research Centre 768 „Managing cycles in innovation processes,“ member of the coordination board of the DFG Priority Program 1593 „Design for Future,“ and is member of the National Academy of Science and Engineering (acatech).

| 40 TUMs MSRM Community

41 | PART II

2 Community

In addition to the Sector Leads mentioned above the MSRM Community further con- sists of over 60 TUM principal investigators (as of June 2020).

MSRM Community in alphabetical order:

Prof. Alin Albu-Schäffer Prof. Johannes Fottner Prof. Matthias Althoff Prof. Helmut Friess Prof. Stefan Bauberger Prof. Julien Gagneur Prof. Jan Baumbach Prof. Michael Gee Prof. Thomas Bock Prof. Stephan Günnemann Prof. Felix Brandt Prof. Oliver Hayden Prof. Hans-Joachim Bungartz Prof. Reinhard Heckel Prof. Rainer Burgkart Prof. Wolfgang Heckl Prof. Martin Buss Prof. Bernhard Hemmer Prof. Alena Buyx Prof. Joachim Hermsdörfer Prof. Marco Caccamo Prof. Sandra Hirche Prof. Rainer Callies Prof. Florian Holzapfel Prof. Eugenia da Conceição-Heldt Dr. Simon Jacob Prof. Hendrik Dietz Prof. Wolfgang Kellerer Prof. Rüdiger Eisenhart-Rothe Prof. Jan S. Kirschke Prof. Hubertus Feussner Prof. Gudrun Klinker Prof. Massimo Fornasier Prof. Felix Krahmer

| 42 TUMs MSRM Community

Prof. Helmut Krcmar Prof. Bernhard Seeber Prof. Bernhard Küster Prof. Veit Senner Prof. Laura Leal-Taixé Prof. Friedrich Simmel Prof. Dongheui Lee Prof. Karsten Stahl Prof. Sabine Maasen Prof. Sebastian Steinhorst Prof. Jakob Macke Prof. Fabian Theis Prof. Bernhard Meyer Prof. Michael Ulbrich Dr. Olivia Mitscherlich-Schönherr Prof. Wolfgang Wall Dr. Ali Nasseri Prof. Ulrich Walter Prof. Matthias Nießner Prof. Rüdiger Westermann Prof. Vasilis Ntziachristos Dr. Dirk Wilhelm Prof. Alexander Pretschner Prof. Bernhard Wolfrum Prof. Gunther Reinhart Prof. Michael Zäh Prof. Gerhard Rigoll Prof. Majid Zamani Prof. Burkhard Rost Prof. Markus Zimmermann Prof. Markus Schwaiger Prof. Ansgar Schwirtz

43 | | 44 Munich School of Robotics and Machine Intelligence

Location and Contact

Technical University of Munich Munich School of Robotics and Machine Intelligence (MSRM)

Heßstrasse 134 80797 Munich

Heßstraße Germany Dachauer Straße

+49 (89) 289 - 29400 [email protected]

Lothstraße

Acknowledgements

Stefanie Götz, Isabelle Haag, Nicole Ebner, Marina Behr, Olivia Schmitt-Walter, Dr.-Ing. Maria Danninger, Dr.-Ing. Jan Harder, Elisabeth Jensen, PhD, Peter So

45 | | 46 Munich School of Robotics and Machine Intelligence

Imprint

Publisher (V.i.S.d.P.) Technical University of Munich Munich School of Robotics and Machine Intelligence

Editors Prof. Bengler, Prof. Burschka, Prof. Cheng, Prof. Cremers, Prof. Diepold, Prof. Franklin, Prof. Haddadin, Prof. Hemmert, Prof. Knoll, Prof. Lienkamp, Prof. Lüth, Prof. Navab, Prof. Rixen, Prof. Steinbach, Prof. Vogel-Heuser

Layout Birgit Schwintek

Texts and pictures were provided by the respective organizers.

Contact Technical University of Munich Munich School of Robotics and Machine Intelligence Heßstrasse 134 | 80797 Munich | Germany [email protected]

Munich, 17 June 2020

47 |