FRAUNHOFER INSTITUTE OF OPTRONICS, SYSTEM TECHNOLOGIES AND IMAGE EXPLOITATION
FRAUNHOFER-INSTITUT FÜR OPTRONIK, SYSTEMTECHNIK UND BILDAUSWERTUNG IOSB
KARLSRUHE FRAUNHOFERSTRASSE 1 76131 KARLSRUHE TELEFON +49 721 6091-0
ETTLINGEN GUTLEUTHAUSSTRASSE 1 76275 ETTLINGEN TELEFON +49 7243 992-0
ILMENAU INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AM VOGELHERD 50 98693 ILMENAU TELEFON +49 3677 461-0
GÖRLITZ INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AUSSENSTELLE GÖRLITZ ABTEILUNG ENERGIE BRÜCKENSTRASSE 1 02826 GÖRLITZ TELEFON +49 3581 7925354
LEMGO INSTITUTSTEIL FÜR INDUSTRIELLE AUTOMATION (INA) LANGENBRUCH 6 32657 LEMGO TELEFON +49 5261 94290-22 ANNUAL REPORT
WWW.IOSB.FRAUNHOFER.DE
Fraunhofer IOSB Annual Report 2017 / 2018 2017 / 2018 FRAUNHOFER UNITS IN GERMANY FRAUNHOFER IOSB IN A NUTSHELL
Development of innovative cameras. Optimal use and networking of sensors. Processing and analyzing the resulting data streams according to the task at hand, leading to decision Funding support systems for humans or intelligent control mechanisms for autonomous systems. This comprehensive process and exploitation chain, which comprises and combines the core competences Optronics, System Technologies and Image Public sector Industrial sector 24,6% Exploitation, is our domain at Fraunhofer IOSB. 36,7%
Our expertise comes to use in areas as diverse as automation, inspection or security. Like the Fraunhofer-Gesellschaft as a Others 5,9% whole, we are committed to application-oriented research Basic funding for the benefi t of society and economy. We shape the future. 32,8% Scientifi c and technological excellence are just as much a part of our DNA as customer orientation and reliability towards our clients from industry and public authorities.
Business expenses Staff 60 Full-time positions
500 50
400 40
300 30
200 20
100 10
13 14 15 16 17 13 14 15 16 17
Personnel in total Investment
Scientists / engineers Research expenditure more at: www.standortkarte.fraunhofer.de
Others Preface 2
Highlight Activities Autonomous underwater vehicles 4 Modular Drone Detection and Assistance System 6 Cybersecurity Training Lab / Branch Lab Görlitz 8 ML4P – Machine Learning for Production 10
Farewell to Dr. Reinhard Ebert 12
The Institute in Profile 14
Business Units and Respective Project Reports Automation 30 Energy, Water and Environment 44 Visual Inspection 54 Defense 62 Security 76
Core Competences and Department Portfolios Optronics 82 System Technologies 92 Image Exploitation 106
Appendix: Names, Dates, Events Advisory Board 121 Honors and Awards 124 Patents and Trademarks 132 Scientific Publications 142 PREFACE
Prof. Dr.-Ing. habil. Jürgen Beyerer
Dear reader,
growth, in itself, is not an objective for us. As an established Fraunhofer institute, we strive for excellence in research, for substantial technological advance in our fields of competence and for maximum satisfaction on behalf of our customers in economy and administration. In order to reach these goals, we need to procure the necessary resources, generate industry orders and find the right partners.
If, however, following this agenda, our staff and budget numbers rise, this is not unwelcome: it is an indicator that we are successful, that we are doing things right. Therefore, I am pleased to announce that our budget and personnel have been growing continuously for years now, reaching 52 million Euros and 518 regular staff, respectively, in 2017.
Still, looking at specific topics and developments remains much more exciting than overall numbers. This is why in this (bi-)annual report we want to provide an in-depth overview with regard to projects, activities, department portfolios, and, last not least, noteworthy events and news – like the success of our “Arggonauts” team, which has reached the finals of the seven million dollar Shell Ocean Discovery XPRIZE competition. Other examples include the retrieval of a test model of the historic Canadian fighter jet “Avro Arrow” in Lake Ontario with the help of our DEDAVE underwater vehicle and the start of the Fraunhofer Lighthouse Project ML4P headed by Fraunhofer IOSB. These stories you will find in the “Highlights” section right at the beginning, followed by our institute’s profile and comprehensive presen- tations of our business units and departments.
Optronics, System Technologies and Image Exploitation remain our identity-defining core competences. This combination makes us a sought-after partner all along a comprehensive process chain – from devising, characterizing and networking sensors over processing, analyzing and making sense of the resulting data streams to creating intelligent autonomous control mechanisms and decision support systems, including innovative human-machine interaction concepts. A multitude of diverse and fascinating projects arises from this unique competence profile, as you will see in our business units section, starting on page 28 – albeit we had to limit ourselves to a small selection of the actual ongoing projects.
2 There are some important news to report concerning the extended managing circle of the institute and its ties to the local universities:
• Our long-standing quest to create a chair for Optronics at the Faculty of Electrical Engineer- ing and Information Technology of the Karlsruhe Institute of Technology (KIT) has been crowned with success: I am very pleased to announce that Dr. rer. nat. Marc Eichhorn has been appointed KIT Professor of Optronics as of April 1st, 2018. At the same date, he has taken office as head of division at our site in Ettlingen. • Prior to this, at the end of 2017 we had to say goodbye and farewell to Marc Eichhorn’s predecessor as head of division “Optronics and Photonic Systems” in Ettlingen, Dr. rer. nat. Reinhard Ebert. He worked for us with great commitment until long after the regular age of retirement. We are very grateful for his ongoing dedication, now as an external advisor to the Institute. • Dr.-Ing. Peter Bretschneider, head of department at our Ilmenau branch for Applied System Technologies IOSB-AST, has been appointed Professor of Energy Usage Optimization at the Ilmenau University of Technology in November 2016. • IOSB-AST has founded a new branch lab in the city of Görlitz, thus establishing a close connection with the local University of Applied Sciences Zittau-Görlitz (cf. page 9). • With respect to our Lemgo branch for Industrial Automation IOSB-INA, the efforts of creating a professorship for Cognitive Automation at Bielefeld University are well underway. We expect to appoint an appropriate candidate in the second half of 2018.
Our special thanks goes to our partners and clients in business, in government and in the ministries, and to all of Fraunhofer IOSB’s sponsors and advisors. Without the reliable support and cooperation of the federal ministries of Education and Research (BMBF) and of Defense (BMVg) we would not be able to carry out our activities and fulfil our mission. Our gratitude also extends to the employees of IOSB and their excellent work. Their expertise, skills, diligence and academic motivation are the cornerstone of our institute’s success.
Karlsruhe, Ettlingen, Ilmenau, Lemgo and Görlitz, April 2018
Prof. Dr.-Ing. habil. Jürgen Beyerer
3 HIGHLIGHT ACTIVITIES
AUTONOMOUS UNDERWATER VEHICLES COM- PETE FOR THE OCEAN DISCOVERY XPRIZE
To advance human achievement in areas where technology currently offers no clear solutions: this is the aim of several large, ambitious innovation competitions which have enjoyed a renais- sance over recent years. From DARPA Challenges to EU Innovation Prizes and the competitions run by California’s XPRIZE Foundation – these schemes seek to stimulate innovative ideas with the potential to spawn new industries and new jobs. The Shell Ocean Discovery XPRIZE launched in 2016 is one example. The “ARGGONAUTS” team at Fraunhofer IOSB has taken up the challenge.
The primary task is to study the ocean floor. The final will take place in autumn 2018 with the following requirements: 250 km² of seafloor have to mapped within 24 hours – at a depth of 4000 meters. In addition, price-worthy photographs of both a specified object and other archaeological, biological or geological features must be taken. Importantly, the technology used must be essentially autonomous: no human operators are permitted on or below the ocean surface while the measurements are being performed. Finally, all the equipment required for the competition must fit into a standard shipping container.
2
Contact: Dr. Gunnar Brink Phone +49 721 6091-640 [email protected]
4 1
Of the original 32 teams, 20 have been admitted to the semifinals based on their technology 1 A “Great Diver”, one of a and finance concepts. In December 2017, we proved that our solutions meet the criteria swarm of underwater drones necessary to advance to the final round. As one of the nine finalists, we hope our fleet of developed for the XPRIZE extremely cost-efficient submersibles and inflatable, unmanned support boats will continue competition. to perform well and that we will be one of the top three teams in the world. 2 The “ARGGONAUTS” presenting the trophy awarded The Fraunhofer executive board generously provided a budget of over €2 million for the to the finalists. project. This was a great motivation – for a difficult challenge. In just ten months, we had 3 Found with the help of to develop a completely new concept for previously unsolved problems. We had to build a DEDAVE: A 1:8 true-to-scale team, select, order and assemble components and sensors, program software and test every- model of the CF-105 on the thing. All these processes were governed by a framework of public procurement rules. We bed of Lake Ontario. had our team trained in SCRUM techniques for agile development and adapted the method for hardware-intensive projects which encompass a wide range of different technologies.
The investment will pay dividends even if we do not eventually win the prize of up to $5 million. Fraunhofer is gaining important experience in dealing with challenges of this nature, which we are likely to encounter more often in future. We will document our agile development methods and make them available for other teams conducting research under time pressure. We also want to found a spin-off company. Our technology has many beneficial applications – from monitoring deep-sea cables to finding wrecks and archaeological treasures or exploring the seabed for immense reserves of natural resources and using them responsibly.
Tracking Remains of Historic “Avro Arrow” fighter jet Another success story involving autonomous underwater vehicles centers around the DEDAVE developed by Fraunhofer IOSB-AST in Ilmenau (cf. annual report 2015 / 2016). The technology was licensed by Kraken Sonar, Inc. and made it 3 possible to find a test model of the ultrasonic delta-wing interceptor CF-105 in Lake Ontario. The Canadian fighter jet, nicknamed “Avro Arrow”, was being developed in the 1950s. For strategic reasons, the program was abandoned. All documents and parts were destroyed. Today, interest in reconstructing details of the historic project is huge, leading to remarkable efforts to find eight true-to-scale models that had been used in flying tests over Lake Ontario. In September 2017, using DEDAVE, two were detected. The media response was tremendous: the New York Times and many other renowned media outlets reported.
5 HIGHLIGHT ACTIVITIES
MODEAS – MODULAR DRONE DETECTION AND ASSISTANCE SYSTEM
Protection of infrastructures and events against small unmanned aerial vehicles (UAVs), commonly referred to as drones, is a largely unsolved problem. In order to tackle this, Fraunhofer IOSB in 2016 started the self-funded project MODEAS with the idea of creating an integrated system for the detection, localization, classification and tracking of small unmanned aerial vehicles based on a network of linked multi-sensor stations. By now, an experimental prototype exists and has attracted much attention in several demon- strations for potential customers. Depending on the version of the system selected, the modular concept can be equipped with high definition optical cameras with a 360° view, tracking units with telephoto zoom cameras, directional microphones, radio detection modules and laser range finders. The open system architecture allows additional sensors or sensor systems to be integrated as required. Moreover, it can be used to control optional defensive systems (actuators).
The rapid technological development of small unmanned aerial vehicles creates new hazards and potential for abuse: drones can spy on people and property or be used to transport items over conventional perimeter fences, e.g. into prisons. If fitted with explosives or toxins, they can also cause significant damage. Protection against drone attacks of this type requires reliable detection at the earliest possible time – ideally before the drone takes off – in order to initiate appropriate countermeasures. This is the aim of the MODEAS project.
One of the major challenges for drone warning systems is the avoidance of false alarms, e.g. by birds, by private, commercial or public sector drones being used legally and by manned aircraft. To overcome these challenges, MODEAS uses signals from a variety of sensors (optical, acoustic and radio) and an object database which can be updated online. This stores signatures and other relevant properties of a variety of known drone models. MODEAS also makes this reference data available to decision-makers in order to achieve rapid response times using a semi-automated decision support assistant.
What we have achieved so far The MODEAS sensor system has a video-based detection range of up to 500 m around each sensor station. Detection of radio communication signals can be achieved over even greater Contact: distances. When an alarm is triggered by one of the sensor systems, it is validated by imme- Dr.-Ing. Igor Tchouchenkov diately comparing it with data from the other MODEAS sensors and the object database. This Phone +49 721 6091-552 prevents false alarms and ensures MODEAS offers a high level of reliability in addition to excel- igor.tchouchenkov@ lent locating performance. Linking stations allows the system to cover the entire perimeter of iosb.fraunhofer.de a property and process several aerial vehicles simultaneously.
6 1 2
1 The MODEAS sensor-array, MODEAS offers the following key features: including a microphone, a laser • fast, multi-sensor detection and classification, range finder, detection and • multi-object capability, tracking video cameras and • fusion of data and information from various sources, radio antennas. • online, updateable object databases, 2 Typical quadrocopter drone. • decision support, • archiving of relevant information, • scalability, • automatic networking, • intuitive user interface, • simple integration of additional sensors, • interoperability with other systems.
Project details MODEAS is a research project conducted by Fraunhofer IOSB involving about 40 researchers. They are developing hardware and software alike. The project focuses on processes and algorithms as well as sensor components and even complete integrated systems. The concept aims at a flexible, extendible and scalable network of sensor stations with individual multi- sensor configurations that can be tailored to meet their specific requirements. By linking the stations, MODEAS can secure areas of any size including infrastructure and real estate. Furthermore, it has the capability to identify several unmanned aerial vehicles simultaneously.
The functional prototype presented in 2017 is equipped with a high definition, multi-focal, optical camera system (360° view) for initial detection of UAVs, a pan-tilt tracking unit with Literature optical zoom cameras, directional microphones, radio detection modules and laser range [1] Tchouchenkov, I.; Schönbein, R.; finders. The available sensors ensure reliable detection and accurate localization. The system Segor, F.: Einsatzmöglichkeiten und Abwehr kleiner unbemannter Flug- also uses radio detection modules to capture communication between the UAVs and their geräte. – Polizei heute, Mai/Juni ground station and issue an early warning regarding the potential presence of drones in the 2012, S. 74-79 air space. Depending on the drone model, it may be possible to tap the usable data stream [2] Tchouchenkov, I.; Schönbein, R.; Kollmann, M.; Segor, F.; Bierhoff, T.; (downlink) or even take over the pilot controls. Herbold, M.: Detection, Recognition and Counter Measures Against Unwanted UAVs. – In Proc. of the The open system architecture permits the integration of additional sensors specific to the 10th Future Security Research Con- ference, September 15 - 17, 2015, task, such as radar, IR and hyperspectral cameras. Berlin, pp. 333-340 [3] Tchouchenkov, I.; Schönbein, R.; On a higher level, MODEAS supports the user in evaluating threats and selecting possible Segor, F.: Detection and Protection Against Unwanted Small UAVs. - In responses not just through its database of the known capabilities of the detected aerial vehicle Proc. of the Eleventh International but also through situation-dependent risk analysis including assessment of the hazards which Conference on Systems (ICONS 2016), February 21 - 25, 2016, could arise through the use of available defensive measures. Lisbon, Portugal, pp. 26-29
7 HIGHLIGHT ACTIVITIES
1
CYBERSECURITY TRAINING LAB FOR CRITICAL INFRASTRUCTURES AND FOR INDUSTRY 4.0
As society becomes increasingly digitalized, the potential threat of cyber attacks is growing rapidly. In addition to more familiar types of attack, the spotlight is now falling onto large scale attacks on critical infrastructures and industrial complexes. IT security and cybersecurity are thus a key, cross-sectional technology for ensuring that modern society and industry continue to function. Professionally trained IT security specialists are a rare commodity in Germany. So as not to fall behind in the arms race with cyber criminals, IT teams and managers must constantly hone their skills and improve their expertise in order to stay at least one step ahead.
Several Fraunhofer Institutes and universities of applied sciences are now offering a modular, part-time study program to make the results of the latest research available to professionals working in this area. Short-format events in the Cybersecurity Training Lab allow participants to gain qualifications through in-service study and combine cybersecurity modules flexibly for a variety of professional roles. These compact courses for IT teams and managers from the industrial and public sectors take place in a high quality laboratory with state-of-the-art IT infrastructure. Here, they face simulations of real threat scenarios, learn to recognize their significance and consequences and study the application and effectiveness of appropriate solution concepts in practice.
Critical infrastructures / Use cases for energy and water infrastructures Fraunhofer IOSB is involved in two areas in the Cybersecurity Training Lab. One topic deals with “Smart Grid” technologies and equivalent structures for other infrastructures. It considers vulnerabilities in planning and operations, especially risk assessment and strategies for measures aimed at preventing cyber attacks. The training course is designed for planners and operators of utility networks as well as manufacturers of components and solutions. The emphasis here is on network planning and management. Contact: Dr.-Ing. Christian Haas Research in this area is centered at IOSB-AST, the Applied System Technologies branch of IOSB, Phone +49 721 6091-605 in Ilmenau and Görlitz (cf. “Görlitz - A New Site for Fraunhofer IOSB” below). Likewise, [email protected] cybersecurity training events take place at both sites.
Prof. Dr. Jörg Lässig Industrial manufacturing / Industry 4.0 Phone +49 3581 7925-354 Second, the Cybersecurity Training Lab focuses on network and security technologies for [email protected] automation systems with regard to networked systems, Internet connections and cloud
8 2 3
1 Johanna Wanka, former German Federal Minister of Education and Research, at the inauguration of the Görlitz branch lab. technologies for automation tasks. The training course is designed for planners and operators 2,3 Cybersecurity Lab for of automation systems as well as developers of automation solutions. On the user side, critical infrastructures including target groups include all sectors of manufacturing industry and manufacturers of automation a real grid control system. solutions. These activities are based at the Industrial Automation branch IOSB-INA in Lemgo 4 Building of the University of and in Karlsruhe, where the Cybersecurity Training Lab integrates with KASTEL, the cross- Applied Sciences Zittau-Görlitz institutional Competence Center for Applied Security Technology funded by the Federal where the Fraunhofer IOSB Ministry of Education and Research. branch lab is located.
Current training modules and dates are available at www.cybersicherheit.fraunhofer.de
4 Görlitz – A New Site for Fraunhofer IOSB
Starting from December 2016, Fraunhofer IOSB has a fifth site in Germany: the branch lab Görlitz (“Außenstelle” in German wording). This site at the moment comprises one research group with the topic “Cybersecurity for critical infrastructures energy and water”, consisting of four people. The group is part of the department Energy (NRG) of IOSB. It is being lead by Prof. Dr.-Ing. Jörg Lässig, who is also professor of informatics at the University of Applied Sciences Zittau-Görlitz (HSZG). Thus, by starting the Görlitz branch lab, IOSB-AST laid the basis for a new academic partnership, creating synergies with the distinct competences of HSZG in the field of Cybersecurity.
9 HIGHLIGHT ACTIVITIES
FRAUNHOFER LIGHTHOUSE PROJECT ML4P – MACHINE LEARNING FOR PRODUCTION
Machine learning and artificial intelligence are at the heart of today's technical innovations. Machine learning allows for far-reaching and unknown insights into complex systems that can no longer be grasped by human expertise. Methods of machine learning are increasingly establishing themselves in a wide variety of appli- cation domains and developing their disruptive potential there. In order to make them usable in the field of manufacturing and production processes, the Fraunhofer-Gesellschaft is funding the lead project ML4P “Machine Learning for Production”. Under the leadership of IOSB, six Fraunhofer Institutes are involved.
In almost every area of society, the amount of available data is increasing at an explosive rate. So-called cyber-physical systems such as mobile devices, autonomous vehicles, intelligent sensor systems and even home automation systems generate a flood of data that has so far only been used to a limited extent. These data form the perfect basis for the use of machine learning methods. In the wake of the High-Tech Strategy Industrie 4.0 and the associated digitalisation of production, this trend also extends to industry. With production processes increasingly being equipped with sensors and actuators, huge amounts of process data are collected, making it possible to gain deep insights into the sometimes very complex physical and technical interrelationships.
Contact: Dipl.-Ing. Christian Frey 1 Phone +49 721 6091-332 [email protected]
10 2
1 Visualization of learned process behavior by unsuper- vised machine learning methods. 2 Optimization potentials beyond human grasp: production process in a smart factory. Disruptive potential for production plants
The starting point for the ML4P project is our conviction that today's industrial production processes offer far-reaching optimization potentials that can be tapped with methods of machine learning. However, for a targeted optimization of processes, e.g. with regard to quality, process and material parameters, it is indispensable to design and implement methods of machine learning that are appropriately adapted. Then, with the help of data, unknown interrelationships can be learned, processes can be modeled and adaptive mechanisms can be implemented in order to make production plants flexible and quickly adaptable.
In contrast to those application domains of machine learning in which huge amounts of data are available (Internet, social media, etc.), in the industrial context there is “only a lot” of Reducing Time to data, but usually also some additional expert knowledge. For consistent plant optimization, Market: Fraunhofer both must be taken into account: all available data and the entire expert knowledge. In an Lighthouse Projects industrial context, therefore, not only the trend topic of deep learning is interesting, but also Fraunhofer is tackling the a wide variety of other special machine learning methods that can also handle less data while current challenges facing simultaneously making use of previous knowledge. industry head on. Its light- house projects put the focus Systematic procedure for industrial applications on strategic objectives with a view to developing practical Currently, there is still an enormous gap between the algorithms of machine learning and their solutions from which econo- successful application in manufacturing and production processes. A systematic procedure for mies such as Germany’s applying machine learning methods in industrial applications is lacking, which would allow to can benefit. The topics effectively identify the optimization potential hat can be tapped. According to the extensive these projects address are experience of various Fraunhofer Institutes, there is a great demand in the process and piece geared towards economic goods production industry, which is often accompanied by a lack of machine learning expertise requirements. By pooling on the part of the user. their expertise and involving industrial partners at an It is against this background that the Fraunhofer lead project ML4P was launched in January early stage, the Fraunhofer 2018. In addition to Fraunhofer IOSB and IOSB-INA, IAIS, IFF, ITWM, IWM and IWU are also Institutes involved in the involved. The task is to develop a systematic procedure for the use of adapted machine lear- projects aim to turn original ning methods in industrial applications with industry-standard tools to systematically record scientific ideas into market- the relevant knowledge and data of a production plant, to appropriately select adapted able products as quickly as machine learning procedures and to use them to full advantage. possible.
11 FAREWELL TO DR. REINHARD EBERT
At the turn of 2017 / 2018, knowing that his successor had been appointed, Dr. rer. nat. Reinhard Ebert retired from his position as head of division ”Optronics and Photonic Systems” and deputy director. Dr. Ebert had worked for Fraunhofer IOSB and its predecessor institutions for almost four decades, first as a group manager for Laser research, then as head of department Optronics and from 2013 as head of division. During his career, he received numerous scientific awards and served the institute in innumerable ways.
12 2016: For his outstanding services, Dr. Ebert is being awarded the Fraunhofer Taler by executive vice president Prof. Alexander Kurz.
13 THE INSTITUTE IN PROFILE
Established on January 2010, the Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB grew to become Europe’s largest research institute in the field of image acquisition, processing and analysis. IOSB’s other areas of activity are control and automation technology, and information and knowledge management.
IOSB has the same mission as its parent, the Fraunhofer-Gesellschaft. Practical usability lies at the heart of all research activities of both institutions. With its research the IOSB seeks to advance technology-driven innovation; with market analysis it seeks to advance application- driven innovation; and in cooperation with research and industry partners it supports innovation in society and industry. What makes the institute special is that it combines core know-how in optronics, system technologies, and image exploitation with application know- how gained through an extensive dialog with its partners.
Core competences and structure
Optronics is the interface between electromagnetic radiation and electronic signals. It deals with converting information about the appearance of the environment and the objects it contains into electrical signals and electrical signals into optical images. Image Exploitation covers con- ditioning and real-time processing of, and automatic and interactive information extraction from images and videos. System Technologies, which represent a cross-section of expertise and are essential for responding to difficult, comprehensive issues with integrated solutions, may appear to be our most abstract field of research. It covers everything that is required for analyzing, gaining an understanding of, modeling, developing, and controlling complex systems.
While the three core competencies give the institute its distinctive profile, there are 15 departments to date, which constitute the basic operational units. In addition, one joint research group with the Chair for Interactive Real-Time Systems of the Institute of Anthropo- matics guarantees for close ties with the Faculty of Informatics of KIT, the Karlsruhe Institute of Technology. The Competence Triangle on the next page illustrates how each of the departments contributes to the core competences.
With their various key areas, and combining a range of different scientific disciplines, the departments of IOSB cover the entire process chain from signal acquisition through signal analysis to integration into operational systems. In practical use, systems interact with their environment. This, too, is reflected by the activities of IOSB, which cover all degrees of free- dom required for effective system design. The abundance of our expertise gives us a great bandwidth of achievable goals.
14 Left: The Competence Triangle positions the departments of IOSB in relation to the three core competencies. Below: Organisation chart.
15 THE INSTITUTE IN PROFILE
Holistic approach
While finding solutions to our tasks requires sophisticated technologies to deal with the various subproblems, the creation of value and benefit requires a well-organized interplay of powerful components in a coherent whole. Our fields of in-depth expertise include automation technology, system architecture, software engineering, network engineering, information and knowledge management, interoperability technologies and a systematic design of human-machine systems. Typical for problems beyond a certain degree of difficulty and complexity is that ideal solutions are not merely automatisms but rather human-machine systems, in which – in addition to hardware and software – the organization into an overall process is crucial.
In addition to its research and development activities, IOSB has systems evaluation and assessment capabilities. With its unbiased evaluation competence, IOSB supports clients in planning and developing components and systems, in developing concepts and planning facilities, and in procurement.
Business units
As well as calling for scientific and technology skills, best-of-class solutions also need in-depth industry knowledge. This is why we have business units. They do not define our organizational structure, which consists of the abovementioned departments; they rather represent an overlay to that structure in order to unite the expertise of IOSB in its various markets. Our current five business units are listed below. Developing dynamically, they provide specific solutions, services and products tailored to the needs of their specific markets. The departments participate in the business units according to their activities in the respective markets.
Energy, Water Automation and Visual Defense Security Environment Inspection Business Units of IOSB.
16 Locations
Fraunhofer IOSB has five locations in Germany: Karlsruhe, Ettlingen, Ilmenau with its new branch lab Görlitz and Lemgo (cf. map on the inside back cover), as well as a representative office in Beijing.
Director: Prof. Dr.-Ing. habil. Jürgen Beyerer
KARLSRUHE ETTLINGEN ILMENAU / LEMGO BEIJING GÖRLITZ
Division Photonics Advanced System Tech- Industrial Automation Beijing Representative and Optronic nology (AST) Branch (INA) Branch Office of IOSB Systems of Fraunhofer IOSB of Fraunhofer IOSB
Departments: Departments: Departments: Departments: SPR, ILT, MRD, IAD, OPT, SIG, LAS, OBJ, NRG, WMS DIS, MIT IAS, VID, VBV SZA
Head of division Head of AST Head of INA Head of Prof. Dr. rer. nat. Prof. Dr.-Ing. habil. Prof. Dr.-Ing. representative office habil. Marc Eichhorn Thomas Rauschenbach Jürgen Jasperneite Dipl.-Ing. Hong Mu Locations and branches of IOSB.
Institutional ties
Of great importance for the institute are its ties with the Karlsruhe Institute of Technology (KIT), which complements its research capabilities. With the Chair for Interactive Real-Time Systems at the Institute for Anthropomatics (Department of Informatics) and the newly created Chair for Optronics at the Institute of Theory and Systems Optimization in Electrical Engineer- ing (Faculty of Electrical Engineering and Information Technology), both our Karlsruhe and Ettlingen sites collaborate closely with KIT in their research work. With additional consulting activities of university chairs at IOSB, the membership of university professors in the Board of Trustees, lecturing by IOSB staff and more, cooperation with KIT is multi-faceted.
At IOSB’s Lemgo site, besides two professorships at Ostwestfalen-Lippe University of Applied Sciences, a new Chair for Cognitive Automation, to be appointed in the second half of 2018, will establish a new cooperation with Bielefeld University. In Ilmenau, the ties with the local University of Technology have been intensified by the creation of the professorship for Energy Usage Optimization. In addition, with the creation of the branch lab in Görlitz linked to a professorship for Informatics, a new partnership with the University of Applied Sciences Zittau-Görlitz (HSZG) is in place.
17 OVERVIEW Director Prof. Dr.-Ing. habil. Jürgen Beyerer ORGANIZATION CHART
Deputies to the Director
Prof. Dr. rer. nat. habil. Marc Eichhorn Dr. rer. nat. Jürgen Geisler Dr.-Ing. Olaf Sauer
OPTRONICS SYSTEM TECHNOLOGIES HEAD OF ADVANCED SYSTEM HEAD OF INDUSTRIAL TECHNOLOGY (AST) BRANCH AUTOMATION (INA) BRANCH OF FRAUNHOFER IOSB OF FRAUNHOFER IOSB
Head of department OPT Head of department SPR Head of department WMS Head of department DIS Optronics Visual Inspection Systems Water and Mobile Systems Digital Infrastructure Dr. rer. nat. Dipl.-Chem. Prof. Dr.-Ing. Thomas Längle Prof. Dr.-Ing. habil. Prof. Dr.-Ing. Jürgen Jasperneite Helge Bürsing Phone +49 721 6091-212 Thomas Rauschenbach Phone +49 5261 94290-22 Phone +49 7243 992-446 Phone +49 3677 461-124
Head of department SIG Head of department NRG Head of department MIT Signatorics Energy Machine Intelligence Dr. rer. nat. Karin Stein Prof. Dr.-Ing. Peter Bretschneider Prof. Dr.-Ing. Oliver Niggemann Phone +49 7243 992-114 Phone +49 3677 461-102 Phone +49 5261 94290-42
Head of department LAS Head of department ILT Head of department MRD Laser Technology Information Management and Systems for Measurement, Dr. Christelle Kieleck Production Control Control and Diagnosis Phone +49 7243 992-310 Dr.-Ing. Thomas Usländer Dip.-Ing. Christian Frey Phone +49 721 6091-480 Phone +49 721 6091-332
18 IMAGE EXPLOITATION DIVISION:
PHOTONICS
AND OPTRONIC Strategy and Innovation SYSTEMS Management Dr. Gunnar Brink Phone +49 721 6091-640
Head of department IAD Head of department SZA Interactive Analysis and Scene Analysis Diagnosis Dr.-Ing. Karsten Schulz Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 7243 992-106 Phone +49 721 6091-393
Public Relations Head of division Dipl.-Phys. Ulrich Pontes since 1.4.2018 Phone +49 721 6091-300
Prof. Dr. rer. nat. Marc Eichhorn Phone +49 7243 992-210 [email protected] Head of department IAS Head of department VID Interoperability and Assistance Video Exploitation Systems Assigned departments Systems Dr.-Ing. Markus Müller Dr.-Ing. Rainer Schönbein Phone +49 721 6091-250 Optronics Commercial and Technical Phone +49 721 6091-248 Dr. rer. nat. Dipl.-Chem. Management Helge Bürsing Dipl.-Kaufm. Siegbert Böckle Phone +49 721 6091-350 Signatorics Dr. rer. nat. Karin Stein
Object Recognition Dr. rer. nat. Michael Arens
Scene Analysis Dr.-Ing. Karsten Schulz Head of department OBJ Group manager VBV Object Recognition Variable Image Acquisition and Representative Office China, Dr. rer. nat. Michael Arens Processing (Research Group) Beijing Phone +49 7243 992-147 Dr.-Ing. Miro Taphanel Dipl.-Ing. Hong Mu Phone +49 721 6091-389 Phone +86 10 65900 621
19 CONTACT OFFICE CHINA, BEIJING
1
Many German companies have discovered China as an attractive market. However, these 1 Underwater vehicle for companies often also need local partners in applied research. Due to a long-term cooperation water quality monitoring at with several research institutes and industrial partners in China, Fraunhofer IOSB established the Beijing Water Science and a representative office in Beijing as early as in 1996. Technology Institute.
The focus of the representative office is the initiation of research activities focused on the areas of environment and energy. Especially in the field of water supply and water resource management, Fraunhofer IOSB is involved in many R&D projects in China.
2016 and 2017 were very successful years for the cooperation with China. We could acquire several projects with partners in China. Some examples are as follows: • solutions for wireless data transmission of water quality data • condition monitoring for wind turbines • development of two remotely operated underwater vehicles (ROVs) for water quality monitoring and observations of reservoirs and aquacultures
As part of the funding program “International Partnerships for Sustainable Technologies and Services for Climate Protection and the Environment“ (CLIENT), the research project “HAPPI“ (Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by Dipl.-Ing. Hong Mu Smart Technologies) has been extended for another year by the BMBF because of the very Phone +86 10 65900 621 successful research results in this project. During this additional year, the innovations of the Fax +86 10 65900 619 HAPPI project will be integrated in the design process of a new cascade of small hydropower [email protected] plants in the Southwest of China. Fraunhofer Representative Another major water project, the EU project INAPRO (Innovative model and demonstration Office Beijing based water management for resource efficiency in integrated multitrophic agriculture and Representative for Production aquaculture system) could be continued. and Information Technologies Unit 0610 Landmark Tower II The competence of Fraunhofer IOSB in the field of Industry 4.0 is highly appreciated by 8 North Dongsanhuan Road Chinese researchers and companies. That is why several training courses were organized in Chaoyang District Germany. 100004 Beijing, PR China
Furthermore, the exchange of scientists between China and Germany could be strengthened: Contacting us in Germany visiting professors of the China Agriculture University and the Beijing Water Science and Prof. Dr.-Ing. habil. Technology Institute, delegations from the China Institute of Water Resources and Hydro- Thomas Rauschenbach power Research as well as from the National Deep Sea Center in Qingdao were welcomed Phone +49 3677 461-124 to Germany. thomas.rauschenbach@ iosb-ast.fraunhofer.de
20 IOSB'S UMBRELLA ORGANIZATION: FRAUNHOFER-GESELLSCHAFT
Research of practical utility lies at the heart of all activities pursued by the Fraunhofer-Gesellschaft. Founded in 1949, the research organization under- takes applied research that drives economic development and serves the wider benefit of society. Its services are solicited by customers and contractual part- ners in industry, the service sector and public administration.
At present, the Fraunhofer-Gesellschaft maintains 72 institutes and research units. The majority of the more than 25 000 staff are qualified scientists and engineers, who work with an annual research budget of 2.3 billion euros. Of this sum, almost 2 billion euros is generated through contract research. Around 70 percent of the Fraunhofer-Gesellschaft’s contract research revenue is derived from contracts with industry and from publicly financed research projects. Around 30 percent is contributed by the German federal and state governments in the form of base funding, enabling the institutes to work ahead on solutions to problems that will not become acutely relevant to industry and society until five or ten years from now.
International collaborations with excellent research partners and innovative companies around the world ensure direct access to regions of the greatest importance to present and future scientific progress and economic development.
With its clearly defined mission of application-oriented research and its focus on key technologies of relevance to the future, the Fraunhofer-Gesellschaft plays a prominent role in the German and European innovation process. Applied research has a knock-on effect that extends beyond the direct benefits perceived by the customer: Through their research and development work, the Fraunhofer Institutes help to reinforce the competitive strength of the economy in their local region, and throughout Germany and Europe. They do so by promoting innovation, strengthening the technological base, improving the acceptance of new technologies, and helping to train the urgently needed future generation of scientists and engineers.
As an employer, the Fraunhofer-Gesellschaft offers its staff the opportunity to develop the professional and personal skills that will allow them to take up positions of responsibility within their institute, at universities, in industry and in society. Students who choose to work For an overview of all Fraunhofer on projects at the Fraunhofer Institutes have excellent prospects of starting and developing a locations in Germany see inside career in industry by virtue of the practical training and experience they have acquired. back cover.
The Fraunhofer-Gesellschaft is a recognized non-profit organization that takes its name from Joseph von Fraunhofer (1787–1826), the illustrious Munich researcher, inventor and more at: entrepreneur. www.fraunhofer.de
21 IOSB AS PART OF FRAUNHOFER GROUPS AND ALLIANCES
FRAUNHOFER GROUP FOR DEFENSE AND SECURITY (VVS)
The Fraunhofer Group for Defense and Security VVS was • Modeling and simulation founded in 2002 and is chaired by Prof. Dr. Jürgen Beyerer. • Multidimensional security research from a technical, social, The total budget of the Fraunhofer Group amounts to economic and political perspective approximately 430 million euros per annum, and more than 3700 employees work for the nine VVS institutes. Portfolio Security is an issue of growing social importance. Threats The group considers its main objectives as follows: posed by terrorism operating internationally, organized 1. Research and development of new technologies and economic crime, major accidents or extreme weather events solutions for the protection of people and the security represent a continuing challenge. of infrastructures 2. Research for national defense In the Fraunhofer Group for Defense and Security VVS, nine Fraunhofer Institutes have joined forces in order to face these Being committed to the German Federal Ministry of Education challenges. As centers of excellence, they create intelligent and Research (BMBF) and the German Federal Ministry of and comprehensive solutions both for civil security as well Defense (BMVg), Fraunhofer VVS has come to assert itself as as for defense in order to improve the protection of society the driving force in the entire defense and security sector. against manmade and natural threats. Even on a European level, Fraunhofer VVS represents one of the key players and facilitates intensive networking with By pooling expertise and research activities, Fraunhofer VVS promising collaborative research activities. Through excellent develops cutting edge technology and the accompanying performance, the Fraunhofer-Gesellschaft significantly con- concepts concerning methods, processes and tactics which tributes to the future strategic orientation of the European are essential for facing the whole spectrum of potential security- and defense-research program. and emerging security threats appropriately. As a result, the Fraunhofer Group is conducting research in the following Core competences business segments: The fields of application can be assigned to defense research on the one hand, and civil security research on the other • Protection of critical infrastructures hand. Fraunhofer VVS’s core competences are: • Management of crises and disasters • Cyber security and defense • Defense research 4-D (land, air, water, and cyber) • Protection and effects • Security research (protection of people and security of • Reconnaissance and surveillance infrastructures, crisis management) • Energetic materials processing and security technology • Technology development (microelectronic, materials, • Communication and information components, information and communication technology) • Command, control and operation • Testing and assessment of operational procedures • Decision-making support for government and economy
22 VVS Management Group Chairman: Prof. Dr.-Ing. habil. Jürgen Beyerer, Fraunhofer IOSB Group Deputy Chairman: Prof. Dr. rer. nat Peter Martini, Fraunhofer FKIE Managing Director: Dipl.-Ing. (FH) Caroline Schweitzer, Fraunhofer IOSB, [email protected]
Members • Fraunhofer Institute for Applied Solid State Physics IAF, Freiburg • Fraunhofer Institute for Chemical Technology ICT, Pfinztal • Fraunhofer Institute for High Frequency Physics and Radar Techniques FHR, Wachtberg • Fraunhofer Institute for Communication, Information Processing and Ergonomics FKIE, Wachtberg • Fraunhofer Institute for High-Speed Dynamics, Ernst-Mach-Institut EMI, Freiburg • Fraunhofer Institute for Technological Trend Analysis INT, Euskirchen • Fraunhofer Institute for Optronics, System Technologies and Image Exploitation IOSB, Karlsruhe
Associated Institutes • Fraunhofer Institute for Integrated Circuits IIS, Erlangen • Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut HHI, Berlin
23 IOSB AS PART OF FRAUNHOFER GROUPS AND ALLIANCES
Fraunhofer Information and Business areas: Communication Technology Group • Digital media • E-Business As the largest ICT research group in Europe, the Fraunhofer Information and Communication • E-Government Technology Group serves as a one-stop shop for industrial customers and media enterprises. • Communication systems • Energy and Sustainability The strengths of the member institutes are pooled strategically and marketed jointly. • Medicine This network makes it possible to translate application-oriented research into customized, • Production integrated solutions for a specific sector: • Security • tailored IT solutions • Financial service provider • competent consulting on technological issues • Automotive • pre-competitive research for new products and services
Regular economy summits unite the right partners from industry and research. The Fraunhofer Information and Communication Technology Group evolves strategies and visions for medium- term priority research areas, providing its member institutes with assistance in the transfer of technology and the marketing of their research activities. The ICT Group also publishes the Contact at IOSB: economy magazine »InnoVisions«, which is available at the kiosk. Prof. Dr.-Ing. habil. Jürgen Beyerer
Fraunhofer Group for Production Business areas: • Product development • Manufacturing technologies The Fraunhofer Group for Production is a cooperative venture by a number of Fraunhofer • Manufacturing systems Institutes, created with the aim of collaborating on production-oriented research and devel- • Production processes opment in order to be able to offer customers in the manufacturing, commercial and service • Production organization sectors comprehensive single-source solutions derived from the pooling of the wide-ranging • Logistics expertise and experience of the individual institutes. The Fraunhofer Group for Production makes use of the latest findings in industrial engineering and information science to offer a Contact at IOSB: range of services that covers the entire product life cycle or value chain. Dr.-Ing. Olaf Sauer
24 Fraunhofer AutoMOBILE Production Alliance Business fields: • Powertrain and running gear • Electric mobility Carmakers, their suppliers, and those equipping the automotive industry, represent a decisive • Planning, control and logistics economic factor in Germany. Significant changes to the entire concept of mobility are ulti- • Car body mately being driven by global trends, such as dwindling natural resources, an increasing need • Vehicle assembly for mobility, urbanization and megacities. In addition, German carmakers and their suppliers • Vehicle interior are facing increasingly tough competition as the trend towards low-cost vehicles takes hold.
The Fraunhofer Alliance pools the expertise of 15 institutes, who collectively provide the German automotive industry with a competent single-source partner for its research and development needs. The complementary effect achieved by combining the individual institutes' key areas of research, makes it possible to generate rapid, integrated and sustainable innova- tions along the entire process chain of vehicle manufacturing – from the planning stage right through to the finished vehicle. The Alliance tackles the challenges posed by environmental policies (reducing fuel consumption and CO2; electromobility; cutting material consumption) Contact at IOSB: while taking full account of commercial imperatives (ongoing pressure to cut costs). Dr.-Ing. Olaf Sauer
Fraunhofer Big Data Alliance Business areas: • Logistics and mobility • Production / Industry 4.0 Big Data is the term used to describe large volumes of all kinds of data that accumulates • Life Sciences and health care rapidly: every day, all over the world, in companies and urban infrastructures, on the web • Data security and even in private households. According to forecasts, the volume doubles every two years. • Energy and environment Processing and analyzing these vast volumes of data is a key technology for high-tech coun- • Business and finances tries. Worldwide, companies expect Big Data will secure strategic competitive advantages as well as boost turnover and productivity.
The Fraunhofer Big Data Alliance provides support from a single source across all sectors and areas of business. Using their many years of experience in analyzing large volumes of data, the individual Fraunhofer Institutes help companies build expertise and to work up solutions that can then be applied to traditional business processes, production and logistics, and also to research and product development. We place feasibility and profitability on equal footing Contact at IOSB: with data protection and security. Prof. Dr.-Ing. habil. Jürgen Beyerer
25 Fraunhofer Energy Alliance Business areas: • Renewable Energy • Energy Efficiency The Fraunhofer Energy Alliance is one of Europe's largest energy research organizations. At • Energy System our 18 member institutes in Germany and the USA, over 2000 employees conduct research on • Energy Storage Renewable Energies, Energy Efficiency Technologies, Intelligent Energy Networks, Digitalization • Energy in digital context of the Energy Industry, Energy Storage as well as Buildings and Components. Our objective • Energy in urban context is to provide our customers with products at the system level which have particularly high investment security, future-orientation and competitive strength.
Small and medium-sized companies as well as general industry and the energy industry are given access to a wide spectrum of research and development possibilities in order to be successful with innovative products and to acquire new markets. Here the entire range of expertise comes from a single source. The Fraunhofer Energy Alliance also provides this Deputy Spokesman expertise in its function as a consultant to political and societal players and institutions. Dr.-Ing. Peter Bretschneider
All our activities focus on the objective of achieving sustainable, secure, economical and Contact at IOSB: socially responsible energy supplies. Dr.-Ing. Peter Bretschneider
Fraunhofer Food Chain Management Alliance Thematic areas: • Food chemistry • Food packaging technology Food Chain Management (FCM) focuses on the chain of food manufacturing as an integral • Logistics process-extending from the primary production via processing and trade until it reaches the • Microsystem technology consumers.
The aim is to analyze and optimize these processes in order to finally supply consumers with qualitatively spotless food as efficiently and reliably as possible.
The Fraunhofer “Food Chain Management” Alliance aims at introducing latest scientific know- Contact at IOSB: how in new products and solutions of this field by means of mutual projects. For this purpose, Dipl.-Ing., Dipl.-Wirt. Ing. the platform Food Chain Management of the Fraunhofer Gesellschaft shall merge the expertise Henning Schulte of all partners, i.e. a total of 10 institutes. Prof. Dr.-Ing. Thomas Längle
Fraunhofer Vision Alliance Business areas: • Industrial image processing • 3D surveying The Fraunhofer Vision Alliance combines the expertise of institutes in the field of image • Thermography processing. • X-ray technology • Surface inspection The main office in Fürth serves as the initial point of contact for customers. This office is • Medical engineering also responsible for the coordination of joint projects. The allianced institutes offer services • Safety engineering relating to applications of innovative sensors, from infrared to x-ray, plus the associated • Traffic engineering handling apparatus. Their work focuses particularly on optical sensing and automated • Terahertz tomography inspection processes for quality assurance.
Contact at IOSB: Prof. Dr.-Ing. Thomas Längle
26 Fraunhofer Water Systems Alliance Business areas: • Urban/periurban water management systems In the Fraunhofer Water Systems Alliance (SysWasser) eleven Fraunhofer Institutes have been • Processes and systems for the sup- pooling their expertise in the research and development of effective water infrastructure ply with drinking and service water systems and technology. • Wastewater treatment processes and systems The alliance’s objective is to take sustainable solutions for water catchment, infrastructure, • Integrated water resource and wastewater treatment and adapt them for use in practical applications on a national and management (IWRM) international level, taking into consideration the relevant social, economic and environmental • Analysis and evaluation of implications. water-economic systems
The use of an integrated, systemic approach linking the energy, waste management and Spokesman: agricultural sectors will contribute towards a more efficient and environmentally compatible Prof. Dr.-Ing. habil. usage of water as a life-essential resource. Thomas Rauschenbach
Contact at IOSB: Prof. Dr.-Ing. habil. Thomas Rauschenbach
Fraunhofer Space Alliance Business areas: • Communication and navigation • Materials and processes Bringing together 15 institutes, the Fraunhofer Space Alliance conducts applied research in the • Energy and electronics field of industrial space technology. Weather forecasts, navigation, real-time transmission for • Surfaces and optical systems satellite TV or global Internet access – space industry applications and services have become an • Protection technology and indispensable part of daily life, underpinning the importance of space technology for a modern reliability industrialized society. In the Fraunhofer Space Alliance, the institutes pool their technological • Sensor systems and analysis expertise in order to provide the industry and funding agencies such as the European Space Agency (ESA) and the European Commission with a central contact.
Fraunhofer acts as systems provider, developing a wide range of top-quality components, integrating them into an overall system and delivering that system to the customer. The sheer technological variety of the participating institutes enables the Fraunhofer Space Alliance to offer its customers a unique range of services. Its business units are Communication and Contact at IOSB: Navigation, Materials and Processes, Energy and Electronics, Surfaces and Optical Systems, Dipl.-Ing. (FH) Caroline Schweitzer Protection Technology and Reliability and Sensor Systems and Analysis. Dr. rer. nat. Dipl.-Phys. Karin Stein
27 BUSINESS UNITS Profiles and Projects
28 AUTOMATION 30
ENERGY, WATER AND ENVIRONMENT 44
VISUAL INSPECTION 54
DEFENSE 62
SECURITY 76
29 BUSINESS UNIT
AUTOMATION
Spokesperson which result from competitive production costs, high equip- Dr.-Ing. Thomas Usländer ment availability, required product quality and guaranteed Phone +49 721 6091-480 delivery times. Mechanical engineers, computer scientists and automation experts must therefore cooperate more closely than ever to meet future requirements. That is what the team of the Automation Business Unit stands for. To date, ICT in production technology has been based on the architectural model of the automation pyramid. Owing to increasing ICT support on all hierarchical levels of the factory, however, there seems to be a new trend according to which the information flow in factories follows the new ”reference architecture model for Industrie 4.0 (RAMI 4.0)”. This model takes account of three dimensions of layers comprising architectural aspects, hierarchy levels and integration spanning Business Unit Development the entire life cycle of production equipment. Dr.-Ing. Olaf Sauer When it comes to enabling shop-floor-related ICT systems to Phone +49 721 6091-477 communicate consistently within the three aforementioned dimensions, for example, it is necessary to connect them systematically with the systems of the digital factory (life cycle dimension) and with automation technology on the control and field levels (vertical integration). To this end, it is indispensable to use unified, general syntax and semantics. Specifically, the activities of the Automation Business Unit focus on the following areas: 1) Manufacturing Execution Systems and production moni- toring and control systems: MES functions will be crucial for tomorrow’s IoT architectures. Real time monitoring Real-time ICT for complex manufacturing processes and control systems become increasingly important for Automation technology is a key factor for the competitive- transparent and safe production. ness of the German manufacturing industry. Automation 2) Industrial standards for interoperable products and IT – and particularly industrial information technology – also systems: Adaptivity is one of the key requirements for the plays a major role in the current debate about cyber-physical factory of the future – not just in physical terms, but increas- systems and the Internet of Things: Information and commu- ingly in terms of software, too. Our current activities in the nication technology (ICT) penetrates all devices, machinery field of PLUGandWORK are game changing in this respect. and equipment in production, on all hierarchical levels, 3) Process intelligence and quality improvement by data ranging from sensors and machine components, machines analytics and machine learning: We use state-of-the-art and their controls to IoT-platforms, interlinked plants and their monitoring and control technology as well as condition visualization across operations by means of monitoring and monitoring to improve plant performance and availability control technology. Industrial ICT has to fulfill high standards, in the process and manufacturing industry.
30 4) Industrial communication: It is our vision to create an Consortium (IIC), working groups of the Platform Industrie Industrial Internet of Things (IIoT) in manufacturing, 4.0, expert panel of the Standardization Council Industrie making real-time information available on all levels of 4.0 (SCI4.0), OPC Foundation and AutomationML e.V. a distributed automation system in the required quality Our ambition is to realize smart production systems and and allowing devices to be integrated on the basis of components based upon open systems architectures and standardized PLUGandWORK principles. associated international standards such as RAMI4.0, OPC 5) Industrial Smart Grids: We deal with the challenge of UA and AutomationML. energy management in manufacturing operations. Equipment / Laboratory Facilities / Software tools To this end, our specialists make use of the principles of • Model factories at IOSB Karlsruhe and at the IOSB smart grids, including the integration with the smart grids sub-institute Industrial Automation (INA) in Lemgo, both of energy providers. We combine our expertise in energy member of the Labs Network Industrie 4.0 (LNI4.0) management and suppliers’ energy data management • IT security lab for industrial production with long-term experience in monitoring production • IIC testbed “Smart Factory Web” plants on behalf of energy consumers. • ProVis testbed 6) Industrial human-machine interaction and assisting systems: • AutomationML™ test center Innovative interaction technologies open up large potentials • Test installation to demonstrate interoperability and adaptivity even in factories. In control rooms, the staff focuses on • Design and simulation tools for engineering and testing operating and monitoring the specific part of a production micro-electronic IPs in the field of eal-timer communication Network-based data loggers for process and system diagnosis or supply chain process of which they are in charge. By • Autonomous robot platforms means of role-based gesture interaction, they will be able • ICT energy laboratory at the sub-institute of Advanced to cooperate in fulfilling interdisciplinary tasks in the future. System Technology (IOSB-AST) This will accelerate the decision-making process, while the system can be used more intuitively. References / product highlights ® 7) Robot systems - Mobile platforms and manipulators: This • ProVis.Agent integrated monitoring, control and reporting system for car body, paint and assembly shops of the area focuses on activities relating to the control of autono- Bremen and Woerth plants of Daimler AG mous and partly autonomous robots and vehicles, acting as • Integration platform in the press shop of the Bremen plant individuals, in groups and in cooperation with human beings. of Daimler AG 8) IT security for industrial production: Today’s production • ProVis.Agent® monitoring and control system for Thyssen plants are highly interconnected. Embedded systems Krupp Steel AG, Duisburg interact independently; planning systems from the cloud • interoperability tools based on AutomationML and OPC UA schedule production steps and machine utilization; plant • Open62541 - open source implementation of OPC UA operators monitor and control remotely; maintenance staff • ProDaMi: suite containing data mining tools for decision has global access to modify configurations. IT security in support in manufacturing industrial production has to take into account specific basic • Predictive maintenance based on machine learning for Bayer AG, Leverkusen conditions which are not as relevant in an office environ- • PROFINET single-chip solution for Phoenix Contact, ment, in the case of PC workstations or Internet servers. Blomberg and Siemens AG, Nürnberg We are member of a variety of industrial consortia and • Various projects relating to Industry 4.0, such as IIoT organizations bringing forward the idea of IIoT and consulting, platform specification, MES-microservices Industrie 4.0, among which are the Industrial Internet specifications
31 1
ISuTest: INDUSTRIAL SECURITY TESTING A Modular Security Testing Framework for Industrial Automation and Control Systems (IACS)
Industrial automation and control systems (IACS) play a key role in modern production facilities. Not only do they add real-time functionality to the connected field devices, they are also increasingly being connected to local networks and the Internet in order to facilitate use cases promoted by “Industry 4.0”. This makes IACS susceptible to cyber-attacks which exploit vulnerabilities, for example in order to interrupt the automation process. Security testing aims to discover these vulnerabilities before they can be exploited. We developed ISuTest, a modular security testing framework for IACS, to enable IACS manufacturers and integrators to perform security testing for their devices.
Task description The objective of security testing is to reveal vulnerabilities. ISuTest applies the negative testing principle which monitors the system’s responses to unexpected inputs. Additionally, ISuTest acts as black-box testing system. In other words, ISuTest tests devices from an attacker’s point of view. Based on a comprehensive review of existing security testing approaches both for common office systems and IACS as well as IEC 62443 as the standard for network and system security in industrial communication networks and its corresponding EDSA (Embedded Device Security Assurance) certification program, we defined the following requirements for ISuTest: (I) ISuTest must be suitable for testing arbitrary IACS for vulnerabilities. (II) ISuTest must be modular and flexibly extensible regarding (a) automation protocols and other network protocols (Profinet, EtherCAT, TCP, ICMP, etc.), (b) input and output modes (Ethernet, digital, analog IO, etc.), and (c) modes of evaluations (network packets, signal behavior, etc.). (III) Vulnerability tests in ISuTest must (a) be defined in test descriptions as declaratively as possible, (b) allow for arbitrary combinations of protocols, input and output modes and evaluations, (c) evaluate outputs against a reference, (d) be executable using fully automated processes in a sequential order, and (e) be reproducible.
Result description Contact: ISuTest is designed to be extendable for use with all kinds of automation protocols and dif- Dr.-Ing. Christian Haas ferent connection technologies as well as to evaluate arbitrary outputs of the tested devices. Phone +49 721-6091-605 In a basic test environment, compliant with the ISASecure EDSA certification program shown [email protected] in Fig. 2, a Test Device (TD) is connected to a Device under Test (DUT). The TD feeds the DUT
32 2 3
with inputs and measures the outputs from the DUT. A test set defines the inputs and outputs 1 Typical IACS components that are expected for those particular inputs. To pass the test, the actual output needs to match which could be exploited by this definition. When testing IACS, the input and outputs can be of different kinds, e.g. digital attackers. or analog signals, or communication via network protocols. 2 Basic test setup consisting of a Testing Device (TD) and the Test cases in ISuTest are defined declaratively in test scripts. Modules can execute arbitrary Device under Test (DUT). operations at defined times of a test execution. Those operations may create DUT input, 3 Experimental setup of ISuTest gather DUT output or control an external device. Modules, as well as evaluations, can be at IOSB Karlsruhe. selected and configured in the test scripts. Evaluations encapsulate a specific algorithm that determines how the DUT’s output and the reference are used to determine the evaluation result. Possible evaluations range from Boolean comparators up to pattern-searching algo- Project execution rithms on packet captures or analog signals. The test scripts are executed by a scanner which Dipl.-Inform. Steffen Pfrang, interfaces the well-known Open Source Vulnerability Assessment System OpenVAS. David Meier M.Sc.
Project description The ISuTest framework was evaluated within the Fraunhofer IOSB Security Laboratory for Industrial Control Systems. An experimental setup is shown in Fig. 3. It consists of the equip- ment required to conduct testing of a typical IACS, including a 24V power supply and network equipment. A remote controllable power switch is used to automatically reset the DUT during testing while a Programmable Logic Controller (PLC) provides access to the digital and analog I/O of the DUT. The framework software is hosted on a dedicated PC system.
Using the setup, we performed various tests with different automation equipment, such as PLCs and bus couplers. The tests were performed automatically which made it possible to repeat the same test with reproducible results. Performing the tests, we identified several weaknesses. For example, a bus coupler crashed: when receiving a specifically-crafted Profinet network packet, it stopped the digital process output without sending an alarm. Even switching the power supply off and on could not reset the device back to normal operation.
Summary The transition in modern industrial facilities towards the IIoT and the ongoing networking of Literature industrial automation and control devices is creating strong demand for increased security. [1] Pfrang, S.; Meier, D.; Kautz, V.: Testing and certification of these systems is necessary to improve the capabilities of manufac- Towards a Modular Security Testing Framework for Industrial Automati- turers, integrators and end users. on and Control Systems: ISuTest, ISuTest is a new and open source industrial security testing framework which fills this gap. (to be published) Its design follows an extensible approach and can be used via OpenVAS which is already [2] ISA Security Compliance Institute (ISCI), “Embedded Device established in the traditional security testing domain. ISuTest was evaluated in an actual Security Assurance (EDSA) - version experimental setup and showed promising results enabling the detection of possible vulner- 2.0.0”, http://www.isasecure.org/ en-US/Certification/IEC-62443-ED- abilities in the tested IACS devices. SA-Certification
33 1
IIC TESTBED SMART FACTORY WEB Creating a marketplace for industrial production
The Smart Factory Web (SFW) is a collaboration between Fraunhofer IOSB and the Korea Electronics Technology Institute (KETI) in the area of Industrial Internet of Things for smart factories. It consists of a web of cooperating factories in Germany and the Republic of Korea and is open for additional facilities, experiments and partners. SFW enables flexible adaptation of production capabilities and sharing of resources and assets to improve order fulfilment and create a marketplace for manufacturers. It addresses architectural and security issues in a connected web of factories. The Industrial Internet Consortium® (IIC™) has approved the SFW as a new member of its family of testbeds to validate its Industrial Internet Reference Architecture (IIRA) and technologies for the Industrial Internet of Things.
Task description
The Smart Factory Web serves as a marketplace for suppliers and service vendors. It applies the IIRA 3-tier architectural pattern in two planes to connect factories and their assets. This intelligent network of smart factories makes it easy for manufacturers to adapt production capabilities and share resources and assets to improve order fulfilment.
Result description
The Smart Factory Web uses IOSB’s WebGenesis® platform to create an interactive and informative visualization of a factory network with asset registration and search. With smart searches, users can assess and compare capabilities of manufacturing sites and order products from the site most suitable for their requirements (Fig. 1). In addition, vendors can quickly respond to changing B2B customer needs. The use of the industrial standards OPC UA and AutomationML facilitates factory-to-factory interoperability enabling cross-site usage scenarios with secure Plug & Work functions and data analytics. It enables flexible assignment of production resources across factory locations so a single business can easily implement Contact: new business models. Factory resources are managed efficiently with a view of all factories by Dr. Kym Watson using mashup, simulation and data analytic services. The SFW reduces IT-system integration Phone +49 721 6091-486 and installation costs and improves equipment utilization by faster engineering and ramp-up [email protected] time of IT systems. Information Management and Production Control www.iosb.fraunhofer.de/ILT
34 2
1 Smart Factory Web visualizes the availability of manufactur- ing resources in an instant. 2 Factories and assets are integrated in stages forming a global marketplace for manufacturing services. 3 3 Capabilities and properties of a packaging machine (asset) Project description of a factory are displayed in a tab-view . The Smart Factory Web uses two planes based on the IIRA’s 3-tier model. In the upper plane, the SFW serves as a portal where assets and interactions across factories are described and visualized (Fig. 2). Users enter information about factories, capabilities and properties of Customer assets in an intuitive, easy-to-configure user interface which visualizes the whole value chain. Korea Electronics Technology Institute (KETI) The lower plane is a Smart Factory with a Factory Digital Image for secure, performant communication with the SFW. Here, Fraunhofer ILT and Fraunhofer INA are contributing Project execution two model factories: Fraunhofer IOSB’s model factory Plug & Work in Karlsruhe and selected Dr.-Ing. Michael Baumann, equipment at the SmartFactoryOWL in Lemgo. KETI’s model factories in Pangyo and Ansan, Kevin Becker, South Korea, are also an integral part of the SFW. They are linked to the German model fac- Dipl.-Ing. Robert Henßen, tories to achieve a cross-factory, cross-organization usage scenario. Factories and their equip- Dipl.-Inform. Kavyashree Jamboti, ment can be set up as assets and their capabilities and properties can be described (Fig. 3). Dipl. Biol. Katja Kornetzky, This can be done either manually or in an automated way by importing an asset description Dr.-Ing. Siegbert Kunz, in AutomationML. Secure Plug & Work techniques based on the standards AutomationML Dr.-Ing. Miriam Schleipen, and OPC UA are applied to adapt factories on-the-fly by inserting new manufacturing assets Dipl.-Inform. Boris Schnebel, into the factory production with a minimum of engineering effort. These standards are Dr. rer. pol. Ljiljana Stojanovic, applied for information modeling and communication in both planes. Dipl.-Ing. Michael Theis, Dr.-Ing. Thomas Usländer, The concept can be applied not only to industrial manufacturing scenarios, but also to Dr. Kym Watson other production chains, for instance in the food industry. Taking fair trade chocolate as an example, it takes just a few hours to describe the whole fair trade chocolate supply chain in SFW, from harvesting cocoa beans to sugar refinement, blending, moulding, packing, labeling and delivery (Fig. 1). The level of detail can be varied as required by the data com- Literature munication across the supply chain. [1] Jung, J.; Song, B.; Watson, K.; Usländer, T.: Design of Smart Factory Web Services Based on the Industrial Internet of Things. Proceedings of the 50th Hawaii In- ternational Conference on System Sciences, 2017, pages 5941-5946
35 1
SmartBox: ADAPTIVE MONITORING ON THE FIELD LEVEL Flexible system for data-driven anomaly detection
Automated production processes offer a wide range of options for networking and control. At the same time, the opening of local networks and increasing complexity of manufacturing processes demands a higher level of technical security and preventive measures to protect them against disruptions from both inside and outside the process. After all, reliability and integrity are key arguments in making Industry 4.0 solutions attractive to manufacturing companies. The “SmartBox” developed by Fraunhofer IOSB-INA in Lemgo offers a universally applicable solution which identifies anomalies in processes using PROFINET data.
Task description More networking of machinery and equipment and the digitization of production processes are opening a host of new opportunities for enhancing efficiency, transparency, control and product variety. At the same time, the early detection of faults and errors is one of the most important tasks in any automated production system. It plays a vital role in reducing costs and the risks of component failures or even production standstills. Calculating failure probabilities should ideally enable operators to prevent faults before they occur [2]. However, manually configuring an error detection system is often complicated and time- consuming as it requires changes to be made in the control program and precise tailoring to the application. This applies particularly if the error detection system is implemented in the programmable logic controller (PLC). In this case, it is usually necessary to reprogram the system – an even more complex task for which a profound knowledge of the entire process from the perspective of the automation engineer and the programmer is essential. Moreover, the data used in error detection on the control level are often filtered or modified. The chal- lenge is to develop a simple, highly self-sufficient system which can be used in a variety of processes and reliably predicts faults based on easily accessible data [3].
Result description The solution developed by Fraunhofer IOSB-INA is a self-configuring unit which is passively Contact: connected to the process and its controls Fig. 1. It learns the behavior of the process auto- Dr.-Ing. Stefan Windmann matically using PROFINET data. It detects errors by comparism of model and observed data Phone +49 5624 94290-51 abstracted from the process and its controls. It can be integrated into any industrial Ethernet stefan.windmann@ system via a switch with mirror port or a network tap. This was tested for a variety of produc- iosb-ina.fraunhofer.de tion plants – including a reconfigurable production system used to process bulk goods and a Machine Intelligence flexible manufacturing system in the SmartFactoryOWL. Fig. 2 and 3 shows the integration of www.iosb-ina.fraunhofer.de the SmartBox into a into a demonstrator. Here, the SmartBox is connected via Ethernet to the
36 Process
Field Device
Switch PLC
Mirror port
SmartBox 2 Switch with Field 3 SmartBox Control port mirror Instrument Prozess
port mirror of a switch between the PLC and field instruments. The extraction of process data 1 SmartBox. from Industrial Ethernet Frames, without communicating via the control level, is the defining 2 Overview of the prototype feature of the SmartBox’s method of operation. It requires no changes to the projected auto- design. mation system. So far, the system has been tested for PROFINET networks. The next phase of 3 The error analysis uses mir- development will implement an extension of the system and enable it to operate with other rored sensor data supplied via industrial Ethernet networks, such as EtherCAT. the switch directly from the field level. Project description The SmartBox can operate in three simple modes: 1) Self-configuration 2) Model learning 3) Error detection
In the self-configuration phase (1), the SmartBox analyzes the initialization frame of the Ethernet system and GSDML files to initialize the information required for model learning and error detection. These files must be saved one time. During model learning (2) and error detection (3), the SmartBox receives and decodes the mirrored process data. In the learning phase (2), it uses the data to generate process models automatically. The data received during the error detection phase (3) are continuously compared with the process model. Deviations are recorded and assessed as possible errors. If these deviations exceed specified limit values, the SmartBox can issue a warning that indications of an error have been detected. A number of different algorithms for both model learning and error detection have already been implemented in the SmartBox.
References The simple technical implementation for recording PROFINET data is not the only remarkable [1] Windmann, S.; Niggemann, O.; aspect of the SmartBox – the handling and preparation of the extracted process data using Trsek, H.: “Konzepte zur Erhöhung machine learning of the process behavior is also a key feature. This uses automatically generated der IT Sicherheit in industriellen Automatisierungssystemen”, in: process models to predict the condition of machines and plants. An explanation is provided Automation 2016, VDI Wissens- using the example of “ComPACT” (Computation of Parallel Automata by Clustering Tech- forum Baden-Baden, 2016 niques) [4] – one of the learning algorithms used in the SmartBox – which is particularly suited [2] Windmann, S.; Eickmeyer, J.; Niggemann, O.: “Fehler in Prozes- to learning discrete process models. Learning procedures for continuous and hybrid processes sen zuverlässig erkennen”, in: atp are also implemented in the SmartBox. The ComPACT algorithm learns from the input and edition, [S.l.], v. 58, n. 04, p. 22-29, apr. 2016. ISSN 2364-3137 output signals recorded from parallel automated machines. [3] Windmann, S.; Niggemann, O.: “A Self-Configurable Fault Detection System for Industrial Ethernet Net- The SmartBox offers a solution for identifying potential anomalies and faults automatically. It works”, in: at – Automatisierungs- requires no integration into the equipment controls and uses a relatively low level of computing technik, 2017 power. The process behavior is modeled independently of the specific process and components [4] Windmann, S.;Lang, D.; Niggemann, O.: “Learning Parallel enabling the operator to identify isolated faults in individual areas or complete processes in Automata of PLCs”, in: 22nd IEEE real-time. The versatility of this solution in a wide range of production processes of any size, International Conference on Emerg- ing Technologies And Factory sector or production environment makes it highly attractive. Automation, 2017
37 1
INTELLIGENT ASSEMBLY ASSISTANCE Interactive networking of man and machine
In fast-moving markets, flexible, customized production processes are in greater demand than ever before. This project aims to develop and evaluate the diverse options for accelerating assembly and initial training processes for employees in different areas of the production environment. It focuses on digitally mapping the assembly process to provide targeted instructions for employees. Benefits are expected to include lower error rates, improved ergonomics and a reduction in the cognitive workloads through the provision of active assistance. During the project, the team developed and evaluated two research demonstrators: IPAS, a fixed-position assembly workstation with visual assistance, and M²-Assist, a mobile version of the assembly assistance system.
Task description The advent of the Industry 4.0 age has been accompanied by an increase in complexity – especially in the daily tasks of employees working closely with production equipment. Assis- tance systems can counteract this perceived growth in complexity by offering individual support for employees, e.g. by providing task-related information directly in the operator’s workplace environment [1][4]. This offers many advantages, such as low error rates, quicker initial training, higher quality processes and production, better occupational health and safety and a general improvement in workplace ergonomics. A few assistance systems based on augmented reality (AR) technologies are already being used successfully by major international companies. Growth rate forecasts for AR-based assistance systems are in the region of 70 % or more annually. This implies that they will have been widely adopted by industry within the next 5 to 10 years. However, systems of this type are rarely used by small and medium-sized enterprises today. This is mostly due to the disadvantages of currently available systems, e.g. high acquisition costs and lack of flexibility. The following project aims to refine and evaluate assistance systems and realize their potential for additional applications in a wide range of areas. Contact: Prof. Dr. Dr. habil. Carsten Röcker Result description Phone +49 5261 70254-88 The project investigated the application potential of AR technologies in an industrial context carsten.roecker@ using a number of demonstrators. The efficient coordination of automated and human iosb-ina.fraunhofer.de assembly processes was studied using the “IPAS” (Intelligent Personalized Assistance System) Digital Infrastructure demonstrator in the SmartFactoryOWL test environment. As well as providing visualized www.iosb-ina.fraunhofer.de information tailored to specific situations and needs, the system can also be converted to
38 2 3
1 IPAS – The intelligent, personalized assistance system. 2 Mobile demonstrator M²-Assist. 3 AR-based assistance using remote support across a number of locations.
Literature new products flexibly and without the need for additional programming. For production [1] Röcker, C.; Robert, S.: Projekti- processes distributed across several sites, the mobile demonstrator M²-Assist uses a networked onsbasierte Montageunterstützung mit visueller Fortschrittserkennung. assistance system which is able to connect assembly stations operating anywhere in the In: visIT – Industrie 4.0, Fraunhofer world. This creates a seamless flow of data and synergies which allow the system to be used in IOSB, Karlsruhe, pp. 12-13, 2016 a broad range of applications. Further, the standards permit collaboration and communication [2] Büttner, S.; Sand, O.; Röcker, C.: Exploring Design Opportunities between two workstations. An augmented reality video conferencing mode permits two tech- for Intelligent Worker Assistance: nicians in separate locations to communicate and help each other in the assembly process A new Approach Using Projection- Based AR and a Novel Hand- from a variety of camera angles. An innovative interactive mode enables them to highlight Tracking Algorithm. In: A. Braun, R. Wichert, A. Maña (Eds.): Ambient specific active areas in the workspace they are observing. Intelligence. Proceedings of the European Conference on Ambient Intelligence and the Internet of Project description Things (AmI’17), LNCS 10217. Using the example of a projection-based assembly assistance system, Fraunhofer IOSB-INA is Springer, Heidelberg, Germany, pp. 33-45, 2017 investigating how assembly technicians can be integrated into the production process according [3] Fellmann, M.; Robert, S.; to their individual capabilities and at what points they can be offered targeted support using Büttner, S.; Mucha, H.; Röcker, C.: existing technologies. Winning the acceptance of users is an important priority and one of the Towards a Framework for Assis- tance Systems to Support Work key factors by which the success of the practical implementation will be judged [3]. By linking Processes in Smart Factories. In: A. Holzinger P. Kieseberg, A M. Tjoa, assembly tasks with information from the virtual world, the employee can be guided through E. Weippl (Eds.): Machine Learning each step of the assembly process – thus increasing the importance of human beings in and Knowledge Extraction. Procee- dings of the International Cross Industry 4.0. As well as an integrated multi-touch screen and pick-to-light modules, users also Domain Conference for Machine have access to visual aids in the form of text, graphics or videos directly at the assembly station Learning & Knowledge Extraction (CD-MAKE’17), LNCS 10410. using projections [1][5]. Gesture recognition and the depth camera system allow the assistance Springer, Heidelberg, Germany, system to be controlled safely and intuitively by touch recognition (“Smart Surface”) even in pp. 59-68, 2017 industrial environments [2]. Further interfaces to position recognition and screw data recognition [4] Sand, O.; Büttner, S.; Paelke, V.; Röcker, C.: (2016). smARt.Assembly systems are available for long-term quality assurance. These are effective in identifying and – Projection-Based Augmented Reality for Supporting Assembly controlling tool processes (e.g. position of a screwdriver). The assistance system can record Workers. In: Lackey S., Shumaker all the production parameters (e.g. components used, assembly stages, duration of assembly R. (Eds.): Virtual, Augmented and Mixed Reality, Lecture Notes in process, etc.) for end-to-end product traceability and save this data directly on the manufactured Computer Science, Vol. 9740, part using RFIDs. During the development process, the team focused on producing a flexible, Springer International Publishing, Switzerland, pp. 643-652, 2016 modular design which would permit individual components of the assistance system to be [5] Paelke, V.; Röcker, C.; Koch, N.; integrated or retrofitted into existing production systems as required. To emphasize the oper- Flatt, H.; Büttner, S.: User interfaces ating principle of the projection-based assembly station, the team also developed a mobile for cyber-physical systems. at- Automatisierungstechnik, 63(10), demonstrator which uses the core technologies of the fixed location workstation. 833-843, 2015
39 1
KARLSRUHE CENTER FOR MOBILITY SYSTEMS Resilient co-operative driving in mixed traffic
The Karlsruhe Center for Mobility Systems (Fraunhofer Leistungszentrum Profilregion Mobilitätssysteme) brings together Karlsruhe’s five Fraunhofer institutes and three universities to offer companies comprehen- sive mobility-related research from a single source. To demonstrate synergies, the participants in the Center’s subproject “Connected Mobility (CM)” jointly elaborated a scenario that integrates all of their areas of research. The core of this scenario is a cyber-attack on car-to-car communication of autonomously driving vehicles. A first realization of the scenario was implemented using the OCTANE simulation platform developed by Fraunhofer IOSB and has been presented to a wide audience at several events including the 2017 Hannover Trade Fair. To achieve resilience to the attack, a visual light communication protocol via car headlights was implemented.
Task description Cooperative driving of autonomous vehicles is a multidisciplinary challenge involving environ- ment sensing, maneuver planning, highly performant and reliable electric / electronic architec- tures, car2car communication based on secure protocols and cryptography, and negotiation techniques to define cooperative groups as well as joint driving maneuvers. One major aspect is the security of the communication. Modern vehicles incorporate all of the necessary technolo- gies and protocols available to prevent intrusion by a hacker. The task of the Karlsruhe Center for Mobility Systems’ subproject “Connected Mobility (CM)” was to highlight cyber risks that remain in the overall system even if the individual cars are perfectly secured.
The main guiding questions of CM participants were: Is it sufficient, if vehicles are perfectly secured? Or is there a weak spot in the system that makes a massive cyber-attack possible? And, if so, do possible mitigation measures exist which are capable of preventing the risk? The challenge was to define a scenario that is plausible in all of the aforementioned aspects of cooperative driving.
Contact: Result description Dr. Dieter Willersinn As a first result, the project identified an attack route capable of causing serious accidents Phone +49 721 6091-387 without the need to manipulate an autonomous car: it appeared to be sufficient for a hacker [email protected] to install a virus on a car driver’s private smartphone. Systems for Measurement, This scenario is relevant to the near future when fully automated cars will share public space Control and Diagnosis with cars that are driven by human drivers. The smartphone virus establishes formally correct www.iosb.fraunhofer.de/MRD car-to-car connections to fully automated cars, incorrectly identifies the smartphone owner’s
40 2
car as being fully automated, and negotiates potential cooperative evasion maneuvers. When 1 Cooperative evasion a particular critical evasion maneuver is requested, it confirms and causes a severe accident risk maneuver. since the smartphone owner is completely unsuspecting and does not react accordingly. 2 Confirmation protocol using Experiments carried out with the IOSB simulation platform OCTANE, confirm the risk and make visual light communication via it possible to evaluate both the potential damage and the effectiveness of countermeasures. LED headlights.
One possible countermeasure is to request a confirmation of the evasion maneuver via an inde- Project execution pendent communication channel. In CM, such a confirmation measure has been implemented Fraunhofer IOSB: by means of visual light communication using LED headlights. This dramatically increases the Dipl.-Ing. Miriam Ruf, effort required by a potential attacker: he must not only infiltrate a smartphone, but also the Prof. Dr.-Ing. habil. Jürgen Beyerer, highly secured IT infrastructure of a car. Dr.-Ing. Christian Frese, Max Filsinger M. Sc., Project description Dipl.-Inform. Masoud Roschani, At the Karlsruhe Center for Mobility Systems (Fraunhofer Leistungszentrum Profilregion Dr. techn. Dieter Willersinn, Mobilitätssysteme), the Fraunhofer Institutes ICT, IOSB, ISI und IWM as well as the Fraunhofer Jens Ziehn M. Sc., Project Group NAS are investigating the mobility of the future in partnership with the Karlsruhe KIT-MRT: Institute of Technology (KIT), the Karlsruhe University of Applied Science (HsKA) and the Ole Salscheider M. Sc., Karlsruhe Research Center for Information Technology (FZI). KIT ITIV: Dipl.-Ing. Falco Bapp, Seven subprojects are dedicated to the central challenges of efficient, intelligent and integrated Prof. Dr.-Ing. Dr. h. c. Jürgen Becker, mobility in all of its aspects and link with important players from science, applied research and Andreas Lauber M. Sc., industry. The Center’s mission is to leverage synergies of existing competences for the develop- KIT-KASTEL: ment of future-proof mobility solutions and establish the necessary partnerships to strengthen Prof. Dr. Jörn Müller-Quade, mobility innovation in and from Baden Württemberg. Dipl.-Inform. Bernhard Löwe, Besides Connected Mobility, six other subprojects focus on various facets of mobility. One Dr.-Ing. Mario Pauli, subproject analyzes changing mobility demands due to demographic change and increasing Dipl.-Inform. Jens Doll, urbanization and derives new mobility solutions and technical solutions. Two other subprojects Dipl.-Math. oec. Christian Hubschneider, address future urban infrastructure and connected mobility enabled by new ICT platforms. Uni Hannover: Prof. Dr.-Ing. Bodo Rosenhahn Automated and autonomous mobility is the topic of another subproject which is developing an autonomous shuttle. Research is also being conducted in the field of hybrid and fully electric Literature [1] Bapp, F.; Becker, J.; Beyerer, J.; as well as combustion engines to further improve efficiency and reduce CO2 emissions. The Doll, J.; Filsinger, M.; Frese, Ch.; seventh project addresses integrated lightweight construction using intelligent combinations Hubschneider, Ch.; Lauber, A.; of materials. Müller-Quade, J.; Pauli, M.; Roschani, M.; Salscheider, O.; Rosenhahn, B.; Ruf, M.; Project Partners Willersinn, D.; Ziehn, J.R.: A Non-- Invasive Cyberrisk in Cooperative The participants to the Karlsruhe Center for Mobility Systems' subproject “Connected Mobility (CM)” include Driving. In: 8. Tagung Fahrerassis- tenz: Einführung hochautomati- four institutes of the Karlsruhe Institute of Technology (KIT), the Karlsruhe Research Center for Information siertes Fahren. 22.-23. November Technology (FZI) and Fraunhofer IOSB which is acting as a coordinator. 2017, München
41 PRIVACY-AWARE ASSISTANCE SYSTEMS Privacy by design and identity management infrastructure
Interactive assistance systems are finding their way into daily life. Smart homes increase our comfort by controlling indoor climate, lighting or entertainment electronics according to our preferences. Future work- places will interactively guide workers through complex manufacturing processes and assist surgeons during surgery. Aiming to be situation-aware and unobtrusive requires such assistance systems to monitor users, objects, and environmental conditions using a multitude of sensors. Personal data is collected and processed on a large scale, which raises privacy concerns and risks of abuse. This applies for workspaces, but also for smart home solutions, which often rely on cloud services for data analysis. Thus, interactive assistance systems have to be designed with caution, keeping in mind the paradigm of Privacy by Design (PbD).
Task description
Like interactive assistance systems, data protection is user-centric. It demands that users maintain sovereignty over their personal data, i.e. users must be able to determine which data is collected and used for which purposes by a digital assistance system. Assistance systems must also be transparent about whether and how long user data is stored, and about optional personal data, i.e. data that is not mandatory for the system to provide its service but may, for example, increase its awareness of a situation. Consider a system that guides a worker through a manufacturing process. The system has to capture the worker’s activities in order to provide appropriate instructions for the detected workflow phase. It may be able to offer even better support if it is allowed to track parameters indicating the worker’s stress level. However, the worker is free to reject this extended data processing option or only agree to it for a short trial period. While raw sensor data typically does not have to be stored (live data), derived informa- tion must, to some extent, persist in order to configure the system for a given user (profile data). Profile data may include information such as “user X is experienced with manufacturing steps a, b, and e”, “user X is left-handed”, or “user X is stressed once his heart rate exceeds 110 bpm”. Profile data may also be directly provided by the user himself (e.g. “left-handed”), and the risk of abuse varies from non-existent to extremely high if it could be used for illegiti- Contact: mate performance monitoring or drawing conclusions regarding the user’s state of health. Dr.-Ing. Pascal Birnstill Phone +49 721 6091-612 [email protected] Interactive Analysis and Diagnosis www.iosb.fraunhofer.de/IAD
42 User Device Assistance System Identity Provider- Service 1. Required Data 3. Authorization and Purposes Token
Hex 2. Authorization, Torx 4. Profile Usage Policy
1
1 Privacy Arrangements between user and assistance system.
Result description
The design of a privacy-aware assistance system must therefore provide an interface for making personal data collection and usage transparent and for defining usage arrangements according to users’ preferences. In other words, this interface needs to be able to commu- nicate with an infrastructure for maintaining and storing users’ profile data including usage policies for the personal attributes contained in a profile. The authors propose the following infrastructure (see Fig. 1). A smartphone app receives data requests from assistance systems. Based on this information, the user can create an abstract profile (list of attributes) and a corresponding usage policy for the given system. The profile data, i.e. the particular attribute values, are stored in an externally operated identity service, so that the user can authorize the assistance system to obtain his profile from there.
An assistance system, on the other hand, must be equipped with trustworthy mechanisms for enforcing the usage policies of profiles (e.g. usage control technology). The correctness of these mechanisms must be verified either by a certification process or by means of software verification methods. Finally, the system’s integrity must be verifiable at any time so the user can make sure that an assistance system has not been manipulated since it was certified/ formally verified. This can achieved by means of remote attestation protocols based on unforgeable hardware trust anchors such as Trusted Platform Modules (TPMs).
Project description
The project “Identities in Smart Environments” run by the Competence Center for Applied Security Technology (KASTEL) and funded by the Federal Ministry of Education and Research started in May 2017 and addresses the challenges described above. Its first task is concerned with deriving privacy requirements from (employee) data protection law in order to produce templates of usage policies which users should be able to arrange with assistance systems Literature and which assistance systems must be able to enforce. Following this, the second task will [1] Krempel et al., Working and living in interactive environments design a generic architecture for interactive assistance systems with integrated usage control - requirements for security and pri- mechanisms for enforcing the identified usage policies. The third task is concerned with the vacy, Ambacher, Oliver (Ed.) et al.: Security Research Conference. development of an infrastructure for identity management, i.e. a user interface for maintain- 11th Future Security: Berlin, Sep- ing profiles and appropriate usage policies, an authorization service for assistance systems to tember 13-14, 2016. Proceedings. Stuttgart: Fraunhofer Verlag, demand access to a given user’s profile and a secure storage service for profiles. 2016, pp. 315-322
43 BUSINESS UNIT
ENERGY, WATER AND ENVIRONMENT
Spokesperson with a wide range of methods and sophisticated algorithms. Prof. Dr.-Ing. Peter Bretschneider An example for these applications is the energy market solution Phone +49 3677 461-102 EMS-EDM PROPHET® that supports utility companies and system operators with varied and complex tasks in a liberalized market environment. In the fields of water management as well as environmental information and early-warning systems, our business unit offers customized ICT applications for the private and public sectors. The objective is to provide integrated solutions that are flexible and can also adapt to individual constraints, such as those of service oriented architectures (SOA) and standard interfaces of the “Internet of Things and Services”. Beside the close collaboration with industry, the business unit sees itself as a technology driver for future energy and water management solutions. Examples are Deputy Spokesperson enhanced power grid solutions (BMWi founded research pro- Prof. Dr.-Ing. habil. jects VEREDELE, REGEES and DynaGrid), the IoT based energy Thomas Rauschenbach management on building and quarter level (BMBF founded Phone +49 3677 461-124 projects EBITA and EffMon). Furthermore, a new Learning Lab IT Security for critical infrastructures was established at the sites Ilmenau and Görlitz in 2017.
Core competencies and markets The business unit has its core competencies in the areas of decision-making-strategies and optimal control solutions for complex technical and non technical processes. Furthermore, service oriented software applications (SOA), semantic technolo- gies and IoT-based frameworks as well as integrated informa- Mission and vision tion and communication systems are the scientific basis for The nexus of sustainable and affordable energy, secure access various applications. The target groups for these applications to clean drinking water and effective environmental protection range from utility companies through communal water suppliers must be better understood and managed through the provision to governmental institutions. The research and development of tools, models and methodologies to exchange and process activities are focused on the global trend of digitalization. In the data. This is fundamental for the development of solutions area of public contract research, we are excellently positioned at meeting the needs of future markets. Fraunhofer IOSB offers the state, federal and European level. The market of innovative integrated ICT systems, consulting services, and development environmental information systems is served by the product suite of prototypes to industrial clients and public authorities that WaterFrame®, which is installed for governmental use. Water- approach the problem from a holistic point of view. They cover Frame® is extended according to customer needs to support the whole spectrum from sensor systems, systems modeling, standards of the Open Geo-spatial Consortium (OGC) compliant and systems analysis to knowledge-based process optimization with the requirements of the Group on Earth Observations (GEO)
44 and Infrastructure for Spatial Information in the European References Community (INSPIRE). It is complemented with WebGenesis® • ABB AG for knowledge- and web-based information systems. • AHK GmbH, Freiburg The business unit’s portfolio is complemented by its know-how • IWHR in the field of maritime system technology, which is specialized • Bonneville Power Administration (BPA) in the guidance of underwater vehicles for automated inspection • China Institute of Water Resources and Hydropower of underwater infrastructures and for water quality monitoring. Research (IWHR) In 2017, Fraunhofer IOSB signed an exclusive licensing agreement • Disy Informationssysteme GmbH, Karlsruhe for it's DEDAVE underwater robotics technology with Canadian • DONG Energy Germany based company Kraken Sonar Inc. • Kraken Sonar Inc. • Ministries of Environment and Federal State Agencies of Laboratory and test facilities Baden-Wuerttemberg (LUBW) / Rhineland-Palatinate / ICT Energy Lab: energy and energy data management, virtual Thuringia (TLUG) / Bavaria (LfU) power plants, operational management of island and area • natGAS AG networks, "Learning Lab IT Security for critical infrastructures" • Nanjing Hydraulic Research Institute Intelligent energy systems research platform: micro grids, • Spacebel, Belgium operational management strategies, storage management, • Stadtwerke Bielefeld GmbH automated metering, intelligent distribution networks, • Stadtwerke Ingolstadt GmbH electric mobility • SWE Energy GmbH & SWE grid GmbH Maritime systems research platform: 250 m³ water volume, • TenneT TSO GmbH lorry access capability, energy and data interface, rail system • The German Federal Institute of Hydrology (1)BfG for object placement, pressure testing system for full ocean • Wasserversorgung Zürich depth (1200 bar / 12.000 m) Smart City / Smart Building living lab: Internet of Things 1 The topics of the Business Unit Energy, (IoT) technology, wireless sensor / actuator networks, smart Water and Environment. control algorithms, data analytics Environmental sensor netwerk INSENSUM: based upon 1 OGC Sensor Web Enablement standards
Product highlights • EMS-EDM PROPHET® - energy and energy data management • Optimized operation control --Electric vehicle fleets: sMobility Commerical, EBUS --Energy Storage: ADELE-ING, SmartRegion Pellworm --Hydroelectric power stations (20 GW): HyPROM (USA) • HydroDyn - grid simulation solution for water and gas • WebGenesis® / WaterFrame® - environmental information system governmental agencies • Thematic information system for the Integrated Rhine Program
45 REGEES – RENEWABLE ENERGY SYSTEM WITH OPTIMIZED GRID INTEGRATION OF RENEWABLE POWER GENERATION
Challenge
The German government’s ambitious aim of pushing renewable power generation up to 50 percent of the overall power generation by 2030 (2050: 80 percent) is a major challenge for grid operators. With a gross power generation of around 190 TWh in 2016, Germany already produces every third kilowatt hour from wind, solar, biomass and hydropower. However, in 2016, the industry incurred costs of EUR 927 million just for redispatch actions and the shutdown of renewable energy generating capacity due to heavily loaded distribution and transmission power grids. Redispatches are unscheduled interventions by transmission system operators into conventional power plants to avoid grid congestion. In just one year, redis- patch activities totaled up to 8116 hours. This implies that Germany’s energy transition to renewable power is entering a new phase of system integration. There is a growing need to upgrade and expand power grids as well as to create greater flexibility in power generation and consumption.
Solution
The research project REGEES (optimized operation control strategies for a reliable power supply system enabling complete integration of renewable power generation by 2030) under the leadership of the Fraunhofer IOSB-AST is seeking solutions. It is attempting to identify the optimum methods for integrating a high proportion of renewable energy into the power sup- ply system. This will require development of coordinated controls for DSO and TSO networks as well as coordinated management of markets and grids. Contact: Advanced System Technology (AST) REGEES has a number of key aspects. The project must define the requirements for the Branch of Fraunhofer IOSB standby generation system and produce a catalog of the necessary changes in the regulatory Dipl.-Ing. Stefan Klaiber framework for reaching 100 percent integration of RES (at 50 percent of the gross power Phone +49 3677 461-105 generation in 2030). It must create optimization and simulation models for the “market grid [email protected] operation” taking into account market roles and responsibilities. In addition, it must produce Energy a catalog for the temporal provision and distribution of essential information between market www.iosb.fraunhofer.de/?14593 and grid players in order to implement the “market grid operation”.
46 Furthermore, the REGEES project has four main overall objectives: first, to tap the flexibility Project partners: potential of power plants for control operation processes; second, to develop innovative grid operation strategies by integrating all grid levels (horizontal-vertical power flow optimization including a possible future overlay grid); third, to utilize the grid as a whole taking account of all available opportunities for storage, control and improved flexibility; and last but not least to enhance the contribution of renewable energy in providing ancillary services for grid operators.
Project execution Prof. Dr.-Ing. Peter Bretschneider Dipl.-Ing. Stefan Klaiber Steffi Naumann M. Sc.
Literature [1] Zimmermann, T.; Klaiber, S.; Bretschneider, P.: "A Market System Operator as a new role to balance the distribution grid and to coordi- nate market and grid operations", IEEE International Energy Confe- rence (EnergyCon), Leuven, Belgium, April 4-8, 2016 [2] Zimmermann, T.; Klaiber, S.; Naumann, S.; Bretschneider, P.: „An Optimization Problem for Acquisition of a Balance Responsible Party in an Extended Scheduling Sys- tem”, International Conference on the European Energy Market (EEM), Dresden, 2017 [3] Klaiber, S.; Naumann, S.; Warweg, O.; Bretschneider, P.: „A New Operation Management Approach to Coordinate Market and Grid Operations”, International ETG Congress, Bonn, 2017
47 1
MOSIOP – MODEL-BASED SIMULATION AND OPTIMIZATION OF UV LED-BASED DISINFECTION SYSTEMS
Sponsored by: BMBF Background
Water is vital for human survival yet more than 660 million people worldwide do not yet have access to potable water. This, in turn, increases the spread of diseases and epidemics. Disinfection of drinking water and the provision of potable water for people everywhere are therefore key components of the UN’s Millennium Development Goals.
Due to their relatively high cost, UVC-LEDs are not yet economically viable for these applica- tions so traditional lamps are currently preferred.
Furthermore, there are a number of open questions regarding the use of LEDs in the disinfec- tion of drinking water which this sub-project aims to clarify.
However, LEDs also have specific characteristics which offer the potential to resolve fundamental difficulties relating to current technologies. An LED does not need a warm-up phase so its power is available instantly. This offers the possibility of intermittent operation. Furthermore, the freedom to arrange LEDs in various configurations and combine different emission wavelengths enables designers to adapt their systems to different mechanisms of action. This opens up a variety of possibilities specifically in the area of reactor design.
Thanks to the increasing efficiency of LEDs, smaller reactors for disinfection will become viable in the medium- to long-term. Moreover, their low power consumption makes them suitable for use with mobile energy sources dramatically increasing the number and scope of Contact: potential applications. Advanced System Technology (AST) Branch of Fraunhofer IOSB Dipl.-Ing. Thomas Westerhoff Phone +49 3677 461-107 thomas.westerhoff@ iosb-ast.fraunhofer.de Water and Mobile Systems www.iosb.fraunhofer.de/?14994
48 2 3
1 Circuit board of the cascad- able UV LED module. 2 Possible linear arrangement of the UV LED module. 3 Possible cylindrical arrange- ment of the UV LED module.
Target
Initially, the main target is the development of a cascadable UVC-LED disinfection module. Project partners • Advanced System Technology The problem of ensuring adequate supplies of drinking water globally means the module will (AST) Branch of Fraunhofer IOSB have to be safe and simple enough for anyone to use anywhere in the affected countries. • PURION GmbH • Xylem Water Services GmbH Basic research will be conducted to close the knowledge gaps which currently exist in the • DVGW - Technologiezentrum field of using UV-LEDs efficiently for water disinfection. The knowledge gained will directly Wasser contribute to the development of the UV-LED module and enable it to be deployed at the POU (point of use) as well as in large-scale plants. Project execution Realization Dr.-Ing. Buren Scharaw Dipl.-Ing. Thomas Westerhoff In the first phase, the Advanced System Technology (AST) Branch of Fraunhofer IOSB will Dipl.-Ing. Steffen Dietze investigate the technical aspects of replacing mercury vapor discharge lamps with LEDs and the corresponding regulations. It will also test different LED arrangements and identify the optimum configuration based on the observed light emission pattern.
Subsequently, the project partners will develop a cooling concept using simulation and experimental techniques with the aim of slowing the ageing process of the LEDs as far as possible.
The development of a pressure and UV-resistant transparent case and a water-proofed module plug connection are further important aims of the project.
The research will conclude with the elaboration of a functional model of the module and the module board.
49 1
HOW TO ACCESS ENVIRONMENTAL SENSOR DATA IN A UNIFORM WAY The potential of the new OGC Standard SensorThings API
A thermostat measures temperature, a smart meter the power consumption – all things will be smarter and contain sensors that monitor the world around us. This leads us to the question: how can we retrieve all this data? Almost every IoT platform has its own interface and all of them work differently. For the management of sensor data, a standard has already been specified by the Open Geospatial Consortium (OGC). The OGC is a non-profit organization founded in 1994 with the aim of defining open standards for the processing of spatial data. This standard has now been in existence for 10 years: the Sensor Observation Service (SOS).
Task description
However, SOS does not really fit into the modern world of the Internet of Things. It is based on heavyweight SOAP and XML, browsing through large data sets is not possible and deleting observations is not supported at all. It is therefore time for something new which is also suitable for devices with limited resources. The OGC has now developed such a standard for managing and querying sensor data: the SensorThings API [1].
The SensorThings API is designed specifically for web developers: it follows the REST principles, data is encoded in JSON and URLs are based on the OASIS OData URL conventions. As a result, all basic functions, such as the creation of new sensors and sensor values, are very simple but complex queries are supported as well. The SensorThings API is complemented by additional extensions. These include the MQTT extension which allows notifications to be generated as soon as a sensor provides new data and the batch processing extension which allows you to send several changes to the server at once. Like all OGC standards, the Contact: SensorThings API is free of charge and open. That is, everyone can see it and participate in Dr. Jürgen Moßgraber the design. Phone +49 721-6091-562 juergen.mossgraber@ Result description iosb.fraunhofer.de Information Management Through its openness and simplicity, the SensorThings API offers everything necessary to and Production Control become the new standard for querying and managing sensor data on the Internet of Things. www.iosb.fraunhofer.de/ILT However, until now there was no open implementation of the API.
50 2
1 OGC Compliance Certificate for the Fraunhofer SensorThings- Server. 2 OGC Dashboard showing live data.
To overcome this problem, Fraunhofer IOSB implemented the first standard-compliant, Project execution open-source server called the "SensorThingsServer". The software is fully based on Open Dr. Hylke van der Schaaf, Source packages and freely accessible on GitHub [2]. For visualization of the sensor data, Michael Jacoby, M. Sc., the IOSB knowledge management system WebGenesis supports dashboard functionality Dipl.-Inform. Reinhard Herzog which can display several types of widgets (e.g. line graphs, maps).
Project description
At Fraunhofer IOSB, we use the SensorThingsServer to collect data about our building: temperature, energy consumption, water consumption, etc. Currently, about 6.8 million observations per month flow into the system. These are then combined with other operating data.
The data are evaluated using a series of Python scripts, Java programs and a LabView evaluation which uses the different selection and filter functions of the SensorThingsServer. Furthermore, a real-time data visualization is used for status displays of different building data.
Designing a new standard which is perfect from the outset is impossible. It is only when the standard is implemented and used independently by different groups that you can find out which details are not quite clear or where improvements are still necessary. For this reason, there is a SensorThings API GitHub project where developers and users can exchange ideas and make suggestions for improvement [3].
Part 2 of the SensorThings API, which is still under construction, will deal with the tasking Literature of actuators. Alongside sensors, these are the second cornerstone of the Internet of Things. [1] Liang et. al. „OGC SensorThings They allow the user not only to read the temperature but also to set the desired value of the API Part I: Sensing“ OGC® Implementation Standard, 2016 thermostat or trigger a motor to open a window. [2] Fraunhofer IOSB SensorThings- Server: https://github.com/Fraunho- ferIOSB/SensorThingsServer [3] SensorThings API GitHub page: https://github.com/opengeospatial/ sensorthings
51 1
SAFEWATER Innovative tools for the detection and mitigation of CBRN-related contamination events of drinking water
The European FP7 project SAFEWATER has developed a comprehensive event detection and event manage- ment solution for drinking water security and mitigation against major deliberate, accidental or natural CBRN-related (chemical, biological, radio-nuclear) contaminations. The key module is the Event Manage- ment System (EMS) which handles incoming events and provides decision support in case of a crisis. The Event Detection System (EDS) detects potentially dangerous constellations of water quality parameters. In case of an event, it is important to provide rapid decision support regarding the best mitigation measures (e.g. opening/closing of valves). Online response tools can predict the spread of the contamination and calculate optimum measures to minimize the impact of the contamination. The simulators can also be used in an offline context to train operational staff. Furthermore, the simulators can be used to train the event detection system.
Task description The European FP7 project SAFEWATER [1,2] has developed a comprehensive event detection and event management solution for drinking water security and mitigation against major deliberate, accidental or natural CBRN-related contaminations. Fig. 1 provides an overview of the structure of the SAFEWATER system. Fraunhofer IOSB developed the Event Management System (EMS) which handles incoming events and provides decision support in case of a crisis (as well as for routine operations). Furthermore, IOSB contributed to the simulators which are able to simulate the hydraulic state and water quality parameters in the drinking water network. The simulators can be used offline (with historical data) and online (using real-time sensor data as input for the simulator). In case of an event, online response tools can predict the spread of the contamination and calculate optimum measures to minimize its impact. The simulators can also be used in an offline context to train operational staff. Furthermore, the simulators can be used to train the event detection system. Contact: Dr.-Ing. Thomas Bernard Result description Phone +49 721 6091-360 The Event Management System (EMS) provides a platform for efficiently managing response [email protected] actions during a contamination event [3]. Alarms produced by several sources, such as event Systems for Measurement, detection algorithms and customer calls, are collected by the EMS and presented on a web- Control and Diagnosis based interface. Human operators evaluate the active alarms and initiate the execution of www.iosb.fraunhofer.de/MRD the response procedures if a possible threat is detected. After a contamination event has
52 2
been declared, the EMS serves as the central point for collecting information and tracking 1 Structure of the SAFEWATER the evolution of the incident by means of periodical situational reports and task management system, ©ARTTIC. capabilities. A number of pre-defined tasks are automatically instantiated depending on the 2 Simulation of the spread of a type of event. This initial set of tasks can be adapted and extended to better suit the current contamination and visualization situation. Since the system is fully web-based it can also be accessed from mobile devices via a web-based GIS. used by technicians in the field.
Offline Simulators: An enhanced and easy-to-use water quality simulator has been provided based on the open source simulator EPANET-MSX [4]. The quality simulator can be used offline based on historical hydraulic data or online in order to predict the spread of contamination (lookahead simulator). For online usage, the SIR 3S hydraulic online simulator is required. Literature Online Simulators: The online usage of the hydraulic and water quality simulator supports [1] http://safewater-project.eu; optimized operation of the distribution network and provides decision support in case of a https://youtu.be/Bs5SljKUxgE (access on 28.06.2017) contamination event. “Lookahead” simulations can be performed to predict the spread of [2] Bernard, T.; Moßgraber, J.; the contamination, calculate possible locations of the source and identify valves which have Elinge Madar, A.; Rosenberg, A.; Deuerlein, J.; Lucas, H.; Boudergui, to be closed to minimize its impact [4]. The simulation tools are connected to the Event K.; Ilver, D.; Brill, E.; Ulitzur, N.: Management System (EMS) of the SAFEWATER solution so most of the visualization of the „SAFEWATER - Innovative tools for the detection and mitigation results and the parameterization of the modules is performed via the web browser-based of CBRN related contamination th EMS. A sample result of the prediction of the spread of a contamination is shown in Fig. 2. events of drinking water.“ 13 In- ternational Conference on Compu- ting and Control for the Water In- Project description dustry (CCWI) 2015, Leicester (UK). Procedia Engineering 119 (2015), The SAFEWATER solution has been implemented, tested and evaluated at three water utilities S.352-359. ISSN: 1877-7058. DOI: 10.1016/j.proeng.2015.08.895 (HaGihon - Jerusalem, WVZ – Zurich and AdA - Portugal) [1]. Six use cases in the SAFEWATER [3] Santamaria, E.; Moßgraber, J.; project were designed to guide the SAFEWATER solution by setting up a number of real-life Deuerlein, J.; Kühnert, C.; scenarios of contamination events likely to challenge municipal water supply systems. The use Bernard, T.: "An integrated system for enhanced response manage- case scenarios were later used to test the effectiveness of the SAFEWATER solution components ment in CBRN related contamina- in dealing effectively with the use cases. The features and functionality of the SAFEWATER solu- tion events of drinking water". In: Proc. 14th International Confe- tion were demonstrated in a live demo at a test network run by the water utility WVZ (Zurich) in rence on Computing and Control 11/2016. In the future, there are plans to install and enhance the SAFEWATER solution at further for the Water Industry (CCWI) 2016, Amsterdam (Netherlands). water utilities. Thomas Bernard (Fraunhofer IOSB) was scientific coordinator of the project. 7.-9.11.2016 [4] Bernard, T.; Kühnert, C.; Santamaria, E.; Moßgraber, J.; Project Partners Deuerlein, J.; Guth, N.; Meyer- Hagihon Ltd. (Israel), Aguas do Algarve SA (Portugal), Wasserversorgung Zürich (Switzerland), Harries, L.; Ovadia, L.; Rosenberg, A.: "Online Hydraulic and Water 3S Consult GmbH (Karlsruhe), Decision Makers Ltd., (Israel), CEA-LIST, (France), ACREO AB (Sweden), Quality Simulator as a Tool for BioMonitech Ltd., (Israel), ARTTIC (France) Contamination Event Response". In: Proc. 14th International Confe- rence on Computing and Control for the Water Industry (CCWI) Project execution 2016, Amsterdam (Netherlands). Dr.-Ing. T. Bernard, Dr. J. Moßgraber, Dr.-Ing. C. Kühnert, Dr. C. Janya-Anurak, E. Santamaria 7.-9.11.2016
53 BUSINESS UNIT
VISUAL INSPECTION
Spokesperson Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212
signal processing for the purpose of quality assurance and / or increasing productivity in real time that come into play when “seeing” is the solution of choice. “Seeing” in this context refers not only to what the human eye is capable of, but also includes the entire electromagnetic spectrum from UV to IR as encountered in the natural and technical world. The technical solutions offered cover a broad service portfolio, ranging from feasibility studies to process developments, practical validation Business Unit Development up to and including demonstrators and productive systems Dipl.-Ing., Dipl.-Wirt. Ing. that can be used at the customer’s site. Henning Schulte Phone +49 721 6091-275 Markets
“Seeing” relevant information forms the basis for our solu- tions. In a technical respect, this generally comprises image acquisition using line scan or area cameras and image analysis in real time. Whether the task is to rapidly monitor a large number of moving parts while sorting bulk goods (in order to separate desirable parts from undesirable ones), detect changes in the reflective properties or the texture of a surface (which are indicative of product defects or process defects) or classify objects or object groups (to detect divergences from Mission and vision specifications), we are able to offer tailored solutions to our partners and customers. Replacing the five human senses with a wide range of technical sensors is something we do on a daily basis. This is especially Whenever the task is to “sort” large quantities of parts true when it comes to acquiring more accurate information or (e.g. bulk goods) in the material flow and in real time or doing so faster than humanly possible; or if we want to use to verify the compliance of complex individual parts with a technical device to replace or assist a person performing a specifications – whether in terms of color, shape or material given task. characteristic – our solutions are put into practice. The solutions we develop are used in recycling glass or enriching In the Visual Inspection business unit, Fraunhofer IOSB gathers minerals to the same extent that they are used in sorting tea, all activities in the field of sensor technology, image analysis and coffee and other foods.
54 1 Food Sorting System in action.
In the inspection of reflective surfaces, we specialise in the References / product highlights recognition of defects for technical but also aesthetic purposes. Defect sizes can be given in absolute or relative terms, and • Binder+Co AG: Systems for sorting recycling glass; sophisticated classifications are available for grading. We also recognizes heat-resistant glass containing lead offer help and simulations for the layout of testing stations. • SALUS Haus GmbH & Co. KG: Systems for sorting tea and Sometimes “taking a look inside parts” or simply “seeing herbs; color, size and debris sorting through them” is helpful when it comes to recognizing • PETKUS Technologie GmbH: Sorting of seed constituents or divergences. If light can be used to make • Uhlmann GmbH: Blister inspection them visible or the materials being searched for have specific • GREIWING logistics for you GmbH: Sorting system for reflective properties, we find them. We also offer solutions for plastic granulates special problems such as “seeing” vibrations from far away, • Zwiesel Kristallglas AG: Inspection of glass lenses for “seeing” in an adverse environment (e.g. in deep-sea envi- occlusions and air bubbles ronments) or recognizing objects for identification purposes. • Eti Maden General Directorate: System for sorting materials (colemanite) Equipment, lab and test facilities • De Beers UK Limited: Systems for finding diamonds
• Sliding tables with a variety of lighting facilities for image acquisition • Experimental systems for sorting bulk goods (each equipped with a camera and blow-out unit) in various configurations as a belt sorter, channel sorter, sorter with chute and free- 1 fall sorting • Measurement stations for inspecting surfaces, e.g.photometric stereo or deflectometry • Measuring devices for 3D inspection • Test systems for transparent materials • Multispectral workbench • Lab equipment for characterizing materials • Microscopic image acquisition stations • Test lab with lighting technology • Fully-automatic BRDF measuring station • Experimental systems for underwater inspection • Cleanroom for inspecting sensible parts
55 1
GONIOMETRIC IMAGERY OF “LIVING SPARKLE” Effect pigments in colored coatings
Effect pigments can create fascinating optical effects on the surfaces of solid objects. They consist of small flakes of metal, mica, polymer or other materials and are embedded in the lacquer layer. Based on optical reflection and interference effects due to varying illumination and observation angles, they can also cause changes of color, texture and gloss. Depending on the concentration of the pigments in the coating, the lac- quer appears either more homogeneous or more sparkling. Due to the properties of the effect pigments, this can lead to the so-called flop effect where the dominant color switches completely or to the living sparkle effect where single eye-catching flakes seem to be twinkling in the dark or even in other lacquer surround- ings. These effects are used in functional tasks, e.g. security printing, as well as many decorative applications in areas such as plastics, cosmetics, printed products, coatings or car paints and even food processing.
Task The quantitative evaluation of effect pigment surfaces requires a methodical approach. To date, no universally accepted standard has been defined by a scientific committee or organization. Nevertheless, some suggestions and recommendations exist and the first gadgets for measuring the optical properties of effect pigments in layers have been presented by manufacturers of optical measurement devices. The manifold optical effects make it essential to consider a wide range of different aspects and a number of questions need to be resolved:
• Angles of illumination and observation: fixed pairs of angles or movement, range of angles • Definition of the light source (spectrum, light intensity, diffuse or directional illumination) • Specification of the optical detector (single sensor, digital RGB-camera or spectrometer, spectral sensitivity and resolution, number of pixels and dynamic range, optical magnification, area of observation, sharpness and depth of focus at inclined observation etc.) Contact: • Analysis, processing and presentation of the measurement data, definition of characteristics, Dr.-Ing. Dipl.-Phys. significant parameters and quantities (density, strength, number, color of sparkle, graininess, Alexander Schwarz range of visibility, etc.) Phone +49 7243 992-103 [email protected] The IOSB was asked to support a major manufacturer of effect pigments in finding suitable Signatorics parameters by testing different experimental conditions in order to capture the appearance of www.iosb.fraunhofer.de/SIG effect pigments in lacquers.
56 2 3
1 Object with effect pigment coating. 2 Image of a coating with effect pigments showing living sparkle effect. (© Merck). 3 Automated goniometer at the Fraunhofer IOSB used for Project the measurements. Fraunhofer IOSB has excellent facilities for conducting extensive optical investigations as well as basic research into the optical properties of reflection and the appearance of samples. The project aim was to capture the living sparkle effect as well as possible. To achieve this, it was Customer necessary to design and build a measurement setup which would subsequently enable the Merck KGaA, Darmstadt image to be evaluated and measure all the physical and statistical properties of the pigments described above. The angle-dependencies were examined with the help of a robot-based Project execution automated goniometer. This allowed the light source and the detector to be moved separately Dr.-Ing. Dipl.-Phys. and independently of each other around the measurement sample, covering a wide range of Alexander Schwarz, angles. Several digital cameras with different pixel numbers, detector sizes, dynamic range Michael Kremer, M. Sc. and sensitivity were used for the test measurements. RGB-cameras were compared to a Markus Richter, B.Eng., detection system consisting of a monochrome camera and an electrical switchable RGB-filter. Sergio Bayon, M. Sc. In addition, the influence of varying beam-spread angles on the appearance of the coating (Uni. Alicante, Merck KGaA) was tested on an optical bench. Since the observed flakes are so small (only a few microns in diameter), the detection unit has to be very sensitive to optical aberrations such as defocus, spherical and chromatic aberration. As a result, some faults or flaws in the cameras were exposed in the images. Therefore, the use of high quality optical components was crucial as well as careful adjustment during the measurement process.
Result Several samples with living sparkle effect have been measured under a variety of conditions. After comparing and evaluating a number of different measurement parameters, a setup consisting of a tungsten lamp with broadband spectrum, an electrical switchable RGB-filter and a monochromatic camera was recommended for the acquisition of high-quality images intended for subsequent image evaluation. The linearity of the selected camera was verified with regard to exposure time and light intensity. During the test series with varying illumination and observation angles it became apparent that the dynamic range of the camera was not sufficient in some situations. Consequently, the exposure times of the camera had to be adapted to avoid saturation of single sparkles and to guarantee an optimal dynamic range even at very small inclination angles. Furthermore, multiple measurements with a reference white panel were recommended for noise reduction and calibration purposes.
57 1
PuritySurf Ellipsometric inline inspection of objects with nonplanar surfaces
Overcoming the geometric restrictions of state of the art ellipsometers, the patented Retroreflex-Laserscan- ning Ellipsometry [1] can detect changes of the state of polarization in or at test objects with flat or curved surfaces. It provides high resolution in combination with high speed image acquisition in a large measure- ment field and is therefore ideally suitable for inline applications. As well as changes in polarization, it can also detect changes in transmittance or reflectance resulting from defects (bubbles, inclusions, cracks etc.). Hence this measurement method allows the qualification of objects, surfaces or coatings regarding aesthetic or functional criteria as well as the material quality. In many industrial production processes ellipsometric measurements can now be used for the first time. The inspection method was verified with a demonstrator (Purity-Surf), described here in detail.
Task description Objects with tightly controlled physical properties are becoming more and more important in industrial production processes. To improve the production of high quality objects or surfaces, measurement systems are necessary that allow a 100% inspection of their physical properties. Ellipsometry is a reliable and very sensitive method for measuring the optical properties of objects. Polarized light illuminates the object. Within a separate receiver the intensity and state of polarization of the reflected or transmitted light from the test object are measured. From these values the optical properties of the inspected object element are calculated by using a physical model of the sample. The model takes account of the test configuration (mainly the angles of incidence) and the physical structure of the test object (object model).
The relevant parameters of the object model are: - the refractive index, - the birefringence, - the extinction coefficient, Contact: - the dichroism, Dr. Matthias Hartrumpf - the depolarization Phone +49 721 6091-444 - and the path length through the material, if applicable. matthias.hartrumpf@ In principle, a set of these model parameters can be measured, if the other parameters are iosb.fraunhofer.de given. Conventional ellipsometry requires an extremely precise alignment of transmitter, object Visual Inspection Systems and receiver relative to each other to even get measurement signals. Hence, it is an estab- www.iosb.fraunhofer.de/SPR lished laboratory method but only in special cases used for inline applications.
58 2
Result description 1 Beam path of a conventional Fraunhofer IOSB has developed and experimentally verified a measurement method which ellipsometer when the reflec- overcomes the geometric restrictions of conventional ellipsometry. tance condition is fulfilled (left) Figure 2 illustrates the principle based on an evaluation of retroreflective beam paths: the or not fulfilled (right). transceiver (receiver and transmitter combined to a single unit) emits a laser beam which first 2 Image of the retroreflex reflects off the surface of the sample and then hits a retroreflector. The reflective film used beam path with double reflec- in the setup does not alter the state of polarization regardless of the angle of incidence tion at the sample surface. (up to approx. 30°) and reflects the incoming beams without any displacement back towards 3 Polarization image of a the sample. After reflecting off the surface of the sample again, the beam finally reaches the varnished plastic test object detector. In this configuration, the retroreflector automatically fulfils the reflection condition acquired with the prototype for a large range of angles and heights of the test object. It overcomes the geometric limitations scanner. of standard ellipsometers and opens the way for new industrial applications of ellipsometry. Alignment of the sample orientation and position to less than 1° resp. fractions of a millimeter relative to the sensor components is no longer necessary to get measurement signals.
Project description A prototype (PuritySurf) for the ellipsometric characterization of materials in industrial processes has been realized. It scans the surface of the test object point-by-point with a laser beam and a sampling frequency of 4 MHz. A deflector unit changes the direction of the laser beam in such a way that it projects a laser line, onto the sample surface while ensuring that the individual 3 light beams are aligned parallel to each other. The line scan frequency is 1 kHz. For each scanned object element, the change in polarization of the reflected or transmitted light is measured Development and marketing simultaneously with several polarization channels. The changes in intensity and polarization partner: caused by the sample are calculated from the measured intensities. Sentech Instruments GmbH The result is a number of polarization images (Fig. 3) which can be used to determine material properties with high spatial resolution. In contrast to conventional realizations of imaging Project execution ellipsometers the prototype provides a wide field of view (line width > 13 cm) and is tolerant Dr. Matthias Hartrumpf, against positional and angular movements of the samples. Using a special laser focusing system Dipl.-Inform. Christian Negara the demonstrator produces sharp images of small structures (down to less than 100 µm) with a large depth of focus. Decorative defects, flaws in the material or the film and inhomogeneities can be visualized and detected in high definition. Literature [1] Hartrumpf, M.: Vorrichtung The principle enables for the first time the performance of ellipsometric measurements in und Verfahren zur optischen several industrial applications, e. g. tensile forces during the production of glass tubes, layer Charakterisierung von Materialien DE 10 2010 046 438 A1, thicknesses on varnished automobile parts, coated metal surfaces or optical components. WO 2012/038036 A1, Precise ellipsometric measurements require that the angle of incidence onto the test object EP 2 848 916 A1 is given to a sufficient degree of accuracy for each measurement point (e.g. by CAD-data). [2] Negara, C.; Hartrumpf, M.: Ellipsometrie an gekrümmten Ober- If absolute values are not essential (e.g. when testing homogeneity or comparing the sample flächen. In: Puente León, Fernando, with a “good” object), a knowledge of the geometry is often not required; an analysis of the Heizmann, Michael (Hrsg.): Forum Bildverarbeitung (2014), KIT Scienti- homogeneity or a comparison of the acquired images is often sufficient to solve these tasks. fic Publishing (2014), S. 227-238
59 1
BAUCYCLE Recycling of construction and demolition waste with advanced sorting technologies
The fine fraction of construction and demolition waste (C&DW) is a component often not considered in recycling efforts for these materials. Nevertheless, with five million tonnes of fine material being generated per year in Germany, this fraction makes up a significant proportion of C&DW. It is generally disposed of in landfill sites. BauCycle, an internal Fraunhofer-funded project, brings together four Fraunhofer institutes with the aim of developing new strategies for recycling fine fraction material. The development of advanced optical sorting technologies for this fine fraction by Fraunhofer IOSB and the use of the sorted material in the production of innovative and functional building products are major goals of the project. However, BauCycle takes an even more comprehensive approach to the recycling process. It uses a number of tools, such as the geographic information system (GIS), to record relevant information in a database. This includes potential material banks (e.g. demolition sites) and sources of demand for the material (e.g. brick producers or cement plants). It also considers information about material logistics and supply chains for the develop- ment of an Internet-based market platform.
Task description The construction sector is one of the most resource-intensive economic sectors in Germany. Each year, it consumes approximately 550 million tonnes of mineral-based raw materials. At around 100 billion tonnes, the entire stock of buildings is an important store of raw materials which can be recycled at the end of its service life. Around 50 million tonnes of demolition material is generated each year. A total of approx. five million tonnes of fine material (< 2 mm grain size) are produced per year in Germany. It is generally landfilled. Only about five percent of this material is suitable for the high-quality recycling on the product level. However, the ongoing discussions on the German government’s framework ordinance regulating the use of mineral replacement construction materials in technical buildings are making this situation increasingly interesting. A suitable recycling process is not yet available for these fractions, even though landfill capacities are becoming scarce Contact: and the primary sources of raw material for fine sand are mined close to their limits. Dr.-Ing. Robin Gruna Phone +49 721 6091-263 Result description [email protected] Recycling C&DW ecologically and economically is a challenging problem. Due to the Visual Inspection Systems heterogeneity of the materials and the technical and safety-related issues associated with www.iosb.fraunhofer.de/SPR fine-grained material flows, the industry requires advanced optical sorting technologies,
60 2
1 C&DW flow according to the BauCycle approach. 2 Advanced optical sorting logistics concepts and product innovations which go far beyond the current technological technology based on problem- level. All these needs are addressed by the BauCycle approach. The project is therefore an specific optical filters. important step towards achieving sustainable reuse of C&DW material and a technological and logistical solution for the circular economy in the building industry in general. The following specific solutions are being developed and will be made available: advanced optical Project execution sorting technologies for sorting fine-grained materials by color and reflectance features in the Dipl.-Ing. Günter Struck, shortwave infrared (SWIR) spectral range (Fig. 3), an online marketplace that addresses the Dr.-Ing. Miro Taphanel, synchronization of demolition and construction sites using specific simulation algorithms, Jürgen Hock, M. Sc. and innovative and functional building products made from recycled C&DW. Furthermore, Dr.-Ing. Robin Gruna the whole project is being evaluated and assessed by environmental and sustainability analysis.
Project description A cooperation of four Fraunhofer institutes is working on solutions for the material hetero- geneity, technical and safety-related challenges surrounding the recycling process of C&DW. The recycling of the fine-grained waste fractions into production will ensure resource-efficient and sustainable management of raw materials and form the basis of an innovative recycling management strategy. To prevent an emphasis on downcycling applications, such as road con- struction, backfilling or even landfilling, the project envisages the use of the fine material in the production of innovative and functional building products (e.g. wall plaster, alkaline activated components or autoclaved aerated concrete). This is one of the goals intended to reintroduce the raw materials into the production cycle. The main aim of the project is to develop and establish a closed-looped for materials in the construction sector. Fraunhofer IOSB is developing advanced optical sorting technologies for material-specific sorting (Fig. 3), Fraunhofer IBP and UMSICHT are seeking to develop new materials and products made from demolition material and Fraunhofer IML is pursuing a platform-based reorganization of the market. Further, the knowledge and expertise of all partners is focused on assessing the ecological impact.
In the first step, mixtures of pure C&DW components are being used to evaluate different approaches to the development of new products. Functional building elements, such as sound absorbing wall tiles, cement-free binder alternatives or porous lightweight bricks, are some of Literature the materials in focus. Next, successful approaches will be tested with real C&DW collected [1] Dittrich, S., Dörmann, J., from different recycling sites. To enable C&DW to become widely used in the production of Gruna, R., Nühlen, J. und Thome, new building materials, material-specific sorting of the C&DW is essential. Fraunhofer IOSB V. (2016). „Das Verbundprojekt BauCycle — Von feinkörnigem is developing advanced sorting technologies based on optical computing for this purpose Bauabbruch zu funktionalen Bau- (see Fig. 2). In parallel, novel logistic concepts for material transportation are being developed. materialien und Bauteilen, Band 3“. In: Mineralische Nebenprodukte These consider the local and regional structures of the construction and demolition market. und Abfälle, S. 455-463
61 BUSINESS UNIT
DEFENSE
Spokesperson Content Dr. rer. nat. Michael Arens Phone +49 7243 992-147 The IOSB’s core competency lies in research into optronic systems for human and computer vision, real-time processing and analysis of imagery, and full-motion video as well as the necessary information and communication technology for the use of images in network-enabled operations.
Of special significance for the German armed forces is our research and technology work in the following areas: • Design, evaluation and protection of existing and future optical and optronic sensor systems: daylight and night vision, hyperspectral sensing, laser-based sensors and protection against laser threats. Coordinator • Warning sensors, propagation of light through the Dr. rer. nat. Jürgen Geisler atmosphere, signatorics for reconnaissance and protection, Phone +49 721 6091-262 concepts for and evaluation of camouflage, concealment or +49 7243 992-109 and deception. • Network-enabled interoperable real-time processing and analysis of imagery for purposes ranging from wide-area imaging reconnaissance to target detection in weapon platforms, including human-system-integration. • Computer assisted object and situation recognition and image-based methods for object tracking and target handoff. • System architectures for networked simulation and gene- ration of terrain and building models for simulator-based training. Mission The research and technology activity of business unit Defense For the benefit of Germany’s defense as part of Europe and is carried out in three tiers: NATO the Fraunhofer IOSB supports the German ministry • To support the ability of the German ministry of defense of defense and its subordinate authorities as well as the (GMOD) and its subordinate authorities for analysis and defense industry with applied research and technology on evaluation of defense-related technologies the IOSB the areas of imaging with optronic systems, image and signal conducts basic research that is funded by the GMOD in analysis, and architectures for simulation and information the long term. systems. Rapid transfer of our research results in order to • Based on this research the institute conducts technology enhance the ability of the armed forces and to protect our projects of the GMOD with a medium-term horizon and soldiers is our prime objective. specific objectives.
62 • Finally projects with the defense industry lead to solutions • Airborne multisensor platform (VIS, LWIR and hyperspectral) for the forces. These projects are carried out in close coor- • Coalition Shared Data (CSD) reference system to support dination with the GMOD to ensure the independent role integration & testing for STANAG 4559 implementations of the IOSB as consulting entity for the government. • MODEAS – Modular Drone Detection and Tracking System
International cooperations based either on bilateral agree- Reference solutions ments, with contracts from the European Defence Agency • ABUL – Full-motion video exploitation system for (EDA), or common research activities in the context of NATO’s reconnaissance and surveillance (air, land, and sea) Science & Technology Organization (NATO STO) are continu- • VABUL – Video Database ABUL – database for change ously flanking our national defence research work. detection • Avionic ABUL for manned airborne platforms on the To the extent that military security classification does not Hensoldt Mission Computer prevent this, the R&T in business unit Defense is incorporated • RecceMan®: Interactive recognition assistance for aerial and into the IOSB’s applied research for civil purposes performed satellite imagery reconnaissance by the other four units in order to achieve the highest benefit • i2exrep (interactive ISR Exploitation Report) - Interactive for all application areas. application for generating and editing formatted reports, in (Joint) ISR (Intelligence, Surveillance, and Reconnaissance) Equipment, and lab and test facilities • SAR-Tutor – E-Learning-tool for image analysis training • Environment simulation (e. g. for camouflage assessment) • ViSAR – Simulator of geometric SAR-effects • Adaptive optics • Lost Earth 2307 – Serious Game for aerial and satellite • Bidirectional reflectance analysis of materials image interpretation • Airborne platform for imaging radiometrics (AirSIG) • Computer-Aided Interactive Performance Evaluation Tool • Observer performance evaluation CARPET for camouflage assessment • Assessment of visual and infrared imaging systems • OpenCASE – camouflage assessment software • Optronic countermeasures • OMSIS: Onboard Infrared Ship signature Management • Vulnerability analysis of optronical systems and human eyes system with regard to laser threats • Digital Map Table for reconnaissance and situation analysis • Femtosecond laser lab • CSD – Coalition Shared Data Server and Clients according • Human-computer interaction for image analysis to STANAG 4559 for interoperabledata and information (eye gaze, gesture, virtual and augmented reality) dissemination • InnoLab - Serious gaming for image analysis training • DBED (Datenbaum Editor) – Software to create and • VIEW – Virtual Reality Lab maintain a database containing target categories conform • Federation of simulators to STANAG 3596 • Distributed Network Battlelab (DNBL)- Connected confor- • Predicition tool for thermal imaging based on a Thermal mance testing environment for implementations according Range Model (TRM 4) to NATO Standards (STANAGs) • Environment measurement system for characterization of • SAR simulation (CohRaS®: Coherent Ray-tracing based atmospheric effects SAR-Simulator) • GERTICO: Infrastructure for federated simulators • Reconnaissance and surveillance with mobile sensor swarms
63 1
SENSOR SIMULATION AT FRAUNHOFER IOSB Addressing challenges in the assessment and development of modern optronic imagers
As image processing increasingly become an integral part of imaging devices, optronic imagers are becoming a complex and inseparable unit of hardware and software for the user. The image-based algo- rithms employed may enhance the output image or possibly adulterate its content without the observer being aware of it or having full control over the process. To address the need of the defense industry and government departments for a well-founded evaluation and comparison of such optronic imaging systems, Fraunhofer IOSB has started to extend its existing range of simulation tools and develop approaches for image-based imaging device assessment.
Introduction Imager performance is quantified in reconnaissance applications by the maximum range at which an observer can fulfil his task, e.g. the detection of an object in the scene. Thus, the performance assessment of optronic imagers has to take into account the entire optronic chain (Fig.1) including the scene, atmosphere, imaging device, (digital) signal processing, display and the observer. IOSB has many years of experience in determining the range per- formance by either simulations, lab measurements or field trials. For instance, the analytical model TRM4 [1] developed at IOSB is used for optronic imager comparison in various NATO states.
The well-established lab measurement techniques and simulations are being challenged by increasing usage of image-based algorithms, such as turbulence compensation and local con- trast enhancement. Such techniques cannot be directly included in analytical models as these models are based on an abstraction of the scene (the target and background are replaced by an appropriate bar pattern, see Fig. 2), which allows range calculations without referring to an actual image. Contact: Dr. rer. nat. Dipl.-Phys. Approach Stefan Keßler Fraunhofer IOSB is addressing the need for a novel imager performance model within the Phone +49 7243 992-201 ECOMOS (European Computer Model for Optronic System Performance Prediction) project [email protected] in co-operation with research institutes and industry from France, Italy, the Netherlands OPTRONICS and Sweden [2]. The project aims to create a harmonized European model for performance www.iosb.fraunhofer.de/OPT assessment that is capable of handling image-based signal processing. ECOMOS combines
64 2 2
1 The optronic chain. 2 Analytical models: scene abstraction by an equivalent bar pattern. and integrates the French atmosphere model MATISSE, the Dutch TOD (triangle orientation 3 Generation of output images discrimination) model as well as TRM4 and the image-based simulation OSIS from IOSB. in the image-based simulation. Imagers are specified via the TRM4 GUI and the range calculation is done either using the analytical path (TRM4) or the image-based path. In the latter case, the image-based simula- tion is employed to generate images similar to those the actual imager would produce. This Partners is done by a step-wise degradation of a pristine input image, which represents the scene, TNO (The Netherlands), ONERA – along the optronic chain and may include image enhancement algorithms or even proprietary The French Aerospace Lab (France) image processing modules (Fig. 3). Currently, only TOD test patterns are used as scene repre- sentatives and the range performance is determined by a human visual system model based on correlations between the input and output of the image-based simulation. In June 2017, the first ECOMOS workshop was held with interested European industry and administration representatives at IOSB in Ettlingen where the ECOMOS software structure and envisaged result options were presented.
In addition to simulation tools, laboratory measurement techniques also have to be extended Literature to cope with imagers using image-based signal processing. These techniques should be [1] Keßler, S.; Gal, R.; based on a test suite of images that is presented to the imager. The imager performance Wittenstein, W.: “TRM4: Range performance model for electro- is then evaluated by means of the image quality of the resulting output images. With optical imaging systems“ in Infrared this in mind, IOSB has equipped a test site where IR images or dynamic scenes, which are Imaging Systems: Design, Analysis, Modeling, and Testing XXVIII, Proc. generated by a high-resolution IR scene projector, can be presented to thermal imagers. SPIE 10178, 101780P, 2017 Moreover, first results regarding the composition of the test suite and suitable image quality [2] Repasi, E.; Bijl, P.; Labarre, L.; Wittenstein, W.; Bürsing, H.: assessment metrics were obtained by using image-based simulations of thermal imagers and “The European computer model a large number of input images. Different image quality assessment metrics were compared for optronic system performance prediction (ECOMOS)” in Infrared regarding their applicability for real images with different levels of noise and blur [3]. A new Imaging Systems: Design, Analysis, approach for the estimation of image blur based on convolutional neural nets was developed Modeling, and Testing XXVIII, Proc. SPIE 10178, 101780O, 2017 and tested [4]. Compared to other blur metrics, trained models can make noise-insensitive [3] Wegner, D.; Repasi, E.: ”Image blur estimates over a wide range of noise levels. based performance analysis of ther- mal imagers” in Infrared Imaging Systems: Design, Analysis, Model- Regarding the analytical model TRM4, a request has been received for it to be used in system ing, and Testing XXVII, Proc. SPIE 9820, 982016, 2016 design optimization, in trade-off studies or within other software simulations. Such applica- [4] Wegner, D.; Koerber, M.; tions were not possible or cumbersome with previous TRM versions as they were designed Repasi, E.: “Noise-insensitive no- having a user in mind who specifies one optronic system via the GUI and calculates its range reference image blur estimation by convolutional neural networks” performance. This situation has changed with TRM4.v2 released in June 2016. IOSB provides in Infrared Imaging Systems: now customized TRM4.v2 versions that can be directly run from user applications or in Design, Analysis, Modeling, and Testing XXVIII, Proc. SPIE 10178, batch processing mode. 101780G, 2017
65 1
SONAR FOR THE DETECTION OF MARITIME THREATS Evaluation of Side-Scan Sonar for Mine Detection
Sonar systems have been used for imaging and mapping the seabed for several decades. Their continuing popularity is based on the wide range of possible applications in both the civilian and military sectors. In addition to various types of surveys and bathymetry measurements, imaging sonar can be used in maritime archaeology, environmental monitoring, search and salvage operations, for the discrimination of different seabed materials, debris detection and many other areas. But of greatest importance is arguably the military application of sonar for Mine Countermeasure Operations (MCM) regarding naval mines. Waterways, shipping lanes and the areas around oil rigs, offshore wind farms and pipelines need to be maintained and kept safe, while naval mines dating back as far as the Second World War remain a threat to this day, particularly in the English Channel.
Task To counter the threat posed by naval mines and reduce risk to personnel, Autonomous Under- water Vehicles (AUVs) with high-resolution side-scan sonars are used to carry out preliminary surveys of potentially hazardous areas. After a scan has been completed, the detection and classification of mine-like objects is conducted offline while the actual identification and neutralization of potential targets is executed in a separate minehunting operation with the aid of remotely operated vehicles.
The performance evaluation of minehunting operations is an ever-active topic of research. For this, the so-called Percentage Clearing (PC) is an important quantity as it describes the percentage of mines that were correctly detected, classified and neutralized during a given operation and depends strongly on the Probability of Detection and Classification (PDC) within a given region. The doctrine currently used to quantify the PC was conceived specifically for forward-looking sonar systems. Since it can neither readily nor reasonably be adapted for side-scan sonar systems, a new model is required that provides appropriately for all the main factors influencing and impairing the PDC. The goal of our work at Fraunhofer IOSB is to Contact: create a model that can predict the PDC of mine-like objects, automatically and reliably, Dipl.-Math., M. Sc. Claudia Hübner solely on the basis of side-scan sonar survey data. Phone +49 7243 992-252 [email protected] Project description Signatorics A reliable database of sufficient size and diversity is essential to support such a model. However, www.iosb.fraunhofer.de/SIG it is unlikely that the necessary volume of sonar data can be acquired the normal way for any
66 2 3
specific mine-type. As a consequence, synthetically enhanced data will have to be utilized. 1 Diagram of side-scan sonar. More precisely, 3D models of mine-like objects will be inserted into existing sonar imagery. (© Wikipedia) To achieve convincing results, the simulation of underwater signal backscattering and attenu- 2 Side-scan sonar image with ation needs to be sufficiently detailed. Observer trials will be held so as to verify the quality of varied seafloor type (ripple the synthetic data in addition to running tests with existing mine detection algorithms. fields and rock formations). 3 Lacunarity map, dark blue Currently, the focus of our work lies on assessing the various influences on the PDC. Image indicates areas of homogeneity, quality, sharpness and signal-to-noise ratio (SNR) are among the more obvious and straight- dark red indicates heterogeneity. forwardly quantifiable factors. Image complexity, on the other hand, can have a significant impact as well. The complexity of a sonar image depends greatly on the composition of seabed materials such as seagrass, rock formations and ripple structures. One reliable way to quantify Customer image complexity is by exploiting image lacunarity, a measure for the "gappiness" of fractals This research is part of the projects which describes how patterns fill space. Differently put, it quantifies the heterogeneity of MALM (Model generation for AUV textures where patterns with more or larger gaps yield higher lacunarity values. Applied to performance evaLuation for Mine- sonar data, this means it can be used to characterize the seafloor in order to assess the cor- hunting) and SOSES (Simulation of responding minehunting difficulty. Objects in Side-scan sonar data for the Evaluation of side-scan sonar Procedure Systems), and commissioned and In order to achieve convincing results when merging simulated mine-like objects with real sponsored by the WTD71 (Tech- sonar imagery it is necessary to understand the basic physics of sonar data first. During a nical Center for Ships and Naval survey, the seabed is scanned in a pattern consisting of (mostly) straight trajectories while Weapons, Maritime Technology including varying view angles and ranges. This means a single survey is usually represented and Research) of the German by a large set of side-scan sonar images along with the corresponding navigational data for Armed Forces. the AUV, e. g. GPS coordinates, altitude, water depth, heading, velocity, etc. Side-scan sonars emit conical sonic pulses in quick succession with a wide fan-shaped angle Project execution perpendicular to the sensor's path and a very narrow angle along its path. Only a moving Dipl.-Math., M. Sc. Claudia Hübner, sensor can create a sonar image: for each sonic pulse the intensities of the echoes are recorded, Dipl.-Inf. Patrick Dunau yielding a line in the resulting sonar image. Bright spots signify a strong signal reflection while dark shadows signify little to no signal reflection, usually because a larger object is occluding the shadowed area. This means that the length of a shadow contains information about the height of an object. However, one needs to take into account that pixel distances are not equidistant but dependent on the relative position of the sensor. Additional factors under consideration are the heading angle of the AUV at any given mea- surement position as well as horizontal beam spreading. The beam spread in particular implies there will be an overlap of echoes originating from successive sonic pulses. At what range the overlap occurs, however, depends primarily on the altitude of the AUV and its speed over ground but also on the heading angle. Furthermore, the scattering and absorbing qualities of the surrounding medium (seawater) need to be modelled as well as the reflective properties of the intended objects with regard to acoustic waves.
67 1
ADAPTIVITY FOR GAME-BASED LEARNING Personalized Adaptive Learning for Military Image Interpretation
Personalized adaptive learning for aerial image interpretation is essential for optimizing reconnaissance processes. Game-based learning concepts, e.g. serious games, could deliver a substantial contribution when combined with face-to-face training courses. With the “E-Learning A.I. (ELAI) Framework” Fraunhofer IOSB has developed a system to enhance existing simulations and serious games. The interoperability approach permits input analysis over multiple systems for adaptivity to users’ skills, knowledge and needs. The design of the ELAI Framework facilitates easy transfer to other game engines, computer simulations or serious games.
Task description The interpretation of aerial and satellite images is one of the most important processes in the military Intelligence Cycle. It requires the detection, recognition, identification and analysis of structures and objects, according to a given task based on optical, infrared and radar imagery. Besides highly developed assets, sensors and image exploitation systems, the success of a reconnaissance mission depends on the interpreter’s analysis performance. Special face-to-face training courses blended with technology-enhanced learning tools, such as E-Learning courses, simulations and serious games, ensure that image analysts are qualified to a high standard. For optimum results, the training process must be well-adapted to the knowledge, skills and needs of the interpreter. Our application scenarios therefore focus on intelligent assistance Contact: and e-learning systems which help users to perform their image interpretation tasks effectively Dipl.-Inf. Alexander Streicher and efficiently. Adaptive serious games and computer simulations help to keep users motivated Phone +49 721 6091-277 and ultimately improve the learning or training outcome. For simulations and games, user alexander.streicher@ engagement can be enhanced by adapting the simulations and games to the user’s individual iosb.fraunhofer.de needs and by keeping the user immersed, e.g. by balancing the adaptivity inside the Flow Channel [1, 2]. Dipl.-Phys. Wolfgang Roller Phone +49 721 6091-247 Result description [email protected] Fraunhofer IOSB developed the “E-Learning Artificial Intelligence” (ELAI) Framework [2] based on the 4-process adaptive cycle for adaptive learning systems. At its core, the ELAI has an Interoperability and Assistance intelligent tutoring controller which interprets the collected data (analysis phase) and adjusts Systems the simulations or games accordingly (select phase) [2]. The captured interaction data is www.iosb.fraunhofer.de/IAS transformed into machine interpretable information in the interpretation engine by applying
68 2 3
so called Didactic Factors and artificial intelligence techniques like clustering and collaborative 1 ELAI Framework. filtering. Based on this information the influence engine selects pre-defined adaptation 2 Lost Earth 2307. strategies to adapt the game to the current user state. Dynamic difficulty adjustment is one 3 Adaptivity Cycle. typical adaptation strategy in the area of image interpretation, e.g. increase difficulty by covering more of the image with dynamically created clouds. The ELAI Framework consists of an ELAI game engine adapter and an externalized ELAI Con- Customer troller which hosts the actual e-learning “intelligence” with an interpretation and an influence Bundeswehr Technical Center engine. Since most of the actual e-learning logic can be externalized, only a minimal-invasive for Information Technology and adapter has to be implemented. The underlying principles are based on commonly accepted Electronics (WTD 81) in Greding standards, like the Experience API (xAPI) or the High Level Architecture (HLA), and on effective adaptive interoperability designs from Learning Management Systems (LMS) [3]. Project execution The ELAI adapter has been realized for the Unity, Havok and VBS3 game engines, however, Dipl.-Inf. A. Streicher, the results are easily transferable to other game engines and applications. Dipl.-Phys. Wolfgang Roller, Dipl.-Inf. (FH) Daniel Atorf M. Sc., Project description Ehm Kannegieser M. Sc., Over recent years Fraunhofer IOSB has developed operational serious games as well as Dipl.-Inform. (FH) Anton Berger innovative game-based learning systems for the German armed forces: Lost Earth 2307 is a 4X-strategy game for optical, infrared and radar image interpretation. It is in operational use at the German training center for military image analysts. [4] EXTRA (Exercise Trainer) is a concept as well as an implementation for modular, Web-based training tools for complex, multi-institutional joint forces exercise scenarios. [5] SaFIRa (Seek and Find for Image Reconnaissance, adaptive) is a prototype implementation of Literature an adaptive seek-and-find game for image interpreters. The game’s objective is to [1] Streicher, A.: Personalized and Adaptive Serious Games, Enter- find objects (e.g. buildings, vehicles, etc.) in an interactive, geographic map from a tainment Computing and Serious top “aerial” view. [2] Games, International GI-Dagstuhl Seminar 2015, pp. 332-377 [2] Streicher, A.: Towards an Interop- The ELAI Framework has been applied to instances of these tools to investigate the concepts erable Adaptive Tutoring Agent for of interaction data capture, analysis, selection and presentation. Initial user studies verified Simulations and Serious Games, International Conference on Theory the feasibility of the architecture and future work could include further A.I. technologies and Practice in Modern Computing and other games or simulations. The externalization of the user model and its interoperable 2015, pp. 194-197 characteristics allows for further learning analytics on the collected data. For instance, [3] Streicher, A.: INTUITEL - Intel- ligent Tutoring Interface for Technol- the A.I. techniques of clustering and collaborative filtering are used to automatically identify ogy Enhanced Learning, Fraunhofer IOSB Annual Report 2013, pp. 74-75 learner profiles and detect suitable learning materials or gameplay recommendations based [4] Roller, W.: Simulation Based Im- on multiple user interaction profiles. age Analysis with Serious Games, Military Scientific Research Annual Report 2013, pp. 20-21 The framework’s development continues and will include further application areas, e.g. [5] Streicher, A.: Scenario Assistant extended adaptivity for the Exercise Trainer EXTRA and for a distributed image-sensor computer for Complex System Configurations, simulation. This also involves the extension to adaptive Virtual Reality (VR) assistance systems International Journal on Computer Science and Information Systems 9 for aerial image interpretation. 2014, pp. 38-52
69 INFORMATION MANAGEMENT – COMBINED AND JOINT Standard development for multinational cooperation of forces
Information superiority is a key factor in maintaining a nation’s security. As recent terrorist attacks have shown, planning starts well beyond national borders and long before the actual event. Military and civil surveillance systems produce huge quantities of data. Although this increases the probability that the relevant information has been gathered, it decreases the probability of identifying the important elements in time. The priority here is to find ways to identify the right (interpretable) information. In the domain of Joint Intelligence, Surveillance and Reconnaissance (JISR), the Coalition Shared Data (CSD) concept and its associated standards are the keys to creating more efficient, higher-level information management processes. Fraunhofer IOSB is a major player in the development of concepts and solutions as well as standardization activities.
Task description Globalization has created complex economic and sociological dependencies over recent decades. The nature of conflicts has changed dramatically and nations are being confronted with a vast number of new threat scenarios. Knowledge superiority is a question of being able to get the right information at the right time to make the right decision and draw the right conclusions. Technology allows us to disseminate information in near real-time and enables both aggressors and defenders to act remotely and network over time and space. Technologies in the areas of sensors and platforms as well as network technology and storage capability have evolved to the level where mass data can also be easily shared and disseminated. To make use of these new capabilities, there is a need for systems and services that can interact with each other in a well-defined way. Compatible interfaces for data exchange and the ability to Contact: interpret the disseminated data correctly are the foundations of these processes. Information Barbara Essendorfer, M. A. management can only be achieved if the participating actors can define common processes and Phone +49 721 6091-596 create a common understanding of their overall goals. To achieve interoperability in such an barbara.essendorfer@ environment, standard development is essential. iosb.fraunhofer.de Interoperability and Assistance Result description Systems The CSD concept started with the sharing of fixed, finished data such as reports, images and www.iosb.fraunhofer.de/IAS video clips. Over time the scope was extended to include the ability to share mutable data –
70 1
1 From collection to dissemi- nation in JISR via the usage of connected STANAGs. such as we can encounter in collaborative business processes where multiple parties modify a common piece of data – and constantly changing data such as video streams. The concept is essentially based on having a network of physically distributed sites which are connected using Customer the available network infrastructure. Among the sites, each node shares information about its Bundesamt für Ausrüstung, persisted content using metadata entries. A global awareness of available data is achieved Informationstechnik und Nutzung by distributing the metadata across all instances of participating sites using appropriate syn- der Bundeswehr (BAAINBw) chronization protocols. Combining this awareness with the ability to retrieve files on demand, ensures ubiquitous access capabilities for data stored on any of the sites in the entire network Project execution with reduced network traffic. CSD is based on STANAG 4559 and connected STANAGs Barbara Essendorfer, M. A., (NATO Standardization Agreements), process descriptions and doctrines. It can be transferred Daniel Haferkorn, M. Sc., to domains with similar requirements. To enhance situation awareness, higher level services Christian Kerth, M. Sc., are developed using semantic world models, data/information fusion and information quality Philipp Klotz, M. Sc., management. Fraunhofer IOSB has developed systems and services for CSD on multiple levels. Dipl.-Inform. Christian Zaschke, Dipl.-Inform. Achim Kuwertz, Project description Dipl.-Math. Jennifer Sander Standard development with regard to interoperability is a complex task. On the one hand, it is necessary to agree a common standard that all involved parties can accept. On the other hand, the descriptions/specifications must be sufficiently detailed to enable an implementation of the standard that is truly interoperable. Also, aspects such as backwards compatibility must be taken into account to enable interoperability between different versions of the same stan- Literature dard. In JISR, processes have to be supported through the use of different standards, so the [1] Essendorfer, B.; Kerth, C.; compatibility between connected standards is an issue. The approach here was for a group Zaschke, C.: Adapting Interoper- ability Standards for Cross Do- of experts to analyze the standards within a multinational project, add documentation where main Usage, Proceedings of SPIE necessary and have the standard implemented by different institutions and companies. The 10207, Next-Generation Analyst V, 102070E, 2017 result was then tested in interoperability exercises on a technical and procedural level using [2] Zaschke, C.; Essendorfer, B.; simulated and, in a final stage, live data. The exercises were accompanied by a test team that Kerth, C.: Interoperability of Het- documented the lessons learned. These were subsequently analyzed by the expert group and erogeneous Distributed Systems, Proceedings of SPIE 9825, Sensors, the whole process started again. The outcomes were adapted processes, specifications and and Command, Control, Com- munications, and Intelligence (C3I) information models. At the same time, the results were fed back into the standardization Technologies for Homeland Secu- process, making them available for a wider community that also could influence the results rity, Defense, and Law Enforcement Applications XV, 98250Q, 2016 and details of the specifications. The supporting multinational project has now been concluded [3] Kuwertz, A.; Sander, J., and the final results are being consolidated by the Custodian Support Team of STANAG 4559. Schneider, G.; Essendorfer, B.: An This is currently chaired by the German MOD and supported by technical experts from different Architectural Framework for ISR Analytics. NATO Symposium on nations, among them Fraunhofer IOSB for Germany. A testing capability is currently being Architecture Assessment for NEC developed to verify future changes made to the standard and provide the ability to assess (SCI-254), Systems Concepts and Integration Panel 2013. Proceed- implementations performed by different vendors. ings: Tallinn, 2013,13 pp
71 1
INVIDEON Fusion of infrared and video images for remote tower applications
“Remote tower operations (RTO)” are currently a very rapidly emerging market. In Germany, Deutsche Flugsicherung (the national air traffic control organization) has plans to operate five German airports ‘remotely’. The cost-efficient collection, transmission, processing and presentation of relevant air traffic data at the RTO workstation is a vital component of this process. INVIDEON (“Infrared/Video Fusion for Remote Tower”) is a collaborative project funded by the German Ministry of Economics and Technology (BMWi). It aims to highlight the opportunities and advantages offered by the additional use of infrared (IR) cameras. IR cameras sense the heat radiated by objects which, for example, provides a better image in poor visibility (fog). As air traffic controllers are not familiar with IR images, it makes sense to overlay the video images in the visible and IR spectra.
Task description Fusing TV and IR image data is an important part of the INVIDEON project. Fraunhofer IOSB has many years of experience in this field and already has processes and algorithms for the following specific tasks: • Process for fusing image data from different spectral ranges by local adaptation to the image content [1] • Process for automatically transferring a point or an object in a sensor’s image to the corresponding point or object in the image data from a different sensor [2]. Fig. 1 shows an example of a fused IR/TV image. In the color TV image (left), the person is difficult to see because it does not have sufficient contrast with its surroundings. In the IR image (center), the person is clearly visible from its body heat. In the fused image (right), the person is also clearly visible and the image retains the colors from the TV camera. These existing processes must be adapted to the specific objectives of the INVIDEON project. Contact: The need to use the image sequences from color TV cameras both for the visualization and Dr. rer. nat. Dipl.-Phys. automatic detection and tracking of objects is likely to pose a special challenge. In particular, Norbert Scherer-Negenborn the required fusion of TV and IR image data must be adapted to a special human-machine Phone +49 7243 992-342 interface and the needs of air traffic controllers. norbert.scherer-negenborn@ iosb.fraunhofer.de Result description Object Recognition In a first measurement project, RDE GmbH and the Institute of Air Transport and Airport www.iosb.fraunhofer.de/OBJ Research (DLR) recorded over 2 hours of image material at the DLR airport in Braunschweig
72 2
using two arrays of IR and TV cameras. This consisted of 16 IR and 10 TV cameras each 1 Example of IR/TV fusion covering a full 360° panorama. Each IR camera provided a sequence of images with a images, left: color TV, center: resolution of 640 x 480 pixels and a refresh rate of 30 Hz. The TV cameras provided image IR, right: fusion. The TV and IR sequences with a resolution of 1920 x 1080 pixels (Full HD) and a refresh rate of 25 Hz. image data were sourced from the benchmark data set [3]. The cameras recorded a variety of scenarios relevant to air traffic controllers, e.g. take-offs 2 Result of the fusion of IR and and landings of small and commercial aircraft, overflights and circling approaches, rolling TV panorama. Top: TV panorama. along the taxiway. From this total of 26 image sequences per scenario, matched series Center: IR panorama. Bottom: of panorama images were generated for the IR and TV images using time and location IR-TV fusion panorama. The registration data and a fused IR-TV panorama was calculated. Fig. 2 shows one individual magnified section shows a small image from these three panoramas. The panorama images and the magnified sections of aircraft in take-off. The aircraft these images show a small aircraft taking off. The aircraft is visible for longer in the fused is visible for longer in the fusion panorama (bottom, in Fig. 2) than in the TV panorama (above, in Fig. 2). panorama (bottom) than in the TV panorama (above). Project description INVIDEON (“Infrared/Video Fusion for Remote Tower”) is a collaborative project which aims Partners to develop and prove the feasibility and utility of displaying fusion image data collected Rheinmetall Defence Electronics by infrared (IR) and video (TV) sensors at a remote tower workstation. The project aims GmbH (RDE), Deutsches Zentrum to integrate the various sensor data into an artificial panorama outdoor view for remote für Luft- und Raumfahrt e.V. (DLR), air traffic controllers. This view combines the advantages of both sensors and is superior DFS Aviation Services GmbH to a purely video-based representation. These advantages include improved long distance Project execution visibility, a higher identification rate, more accurate automatic tracking and greater cost- Dr. Norbert Scherer-Negenborn, benefit ratio. Dipl.-Math. Gabriele Schwan
Literature Automatic identification and tracking of objects based on IR and TV panoramas in airport [1] Schwan, G.; Scherer-Negenborn, operations are another innovation in the area of air traffic control. These processes aim to N.: “An Approach to Select the simplify the user’s job by alerting him automatically to movements on the ground and in Appropriate Image Fusion Algorithm for Night Vision Systems”, SPIE Secu- the air and automatically tracking objects. This may be achieved by fusing live infrared (IR) rity & Defence, 21 - 24 September and TV panorama images and using object identification and tracking algorithms. 2015, Toulouse, France, 2015 [2] Lemaire, S.; Bodensteiner, C.; Arens, M.: “High precision object The images must be registered so the images from the various cameras can be overlaid geo-localization and visualization in sensor networks”, Proc. SPIE or fused in other ways. This means that the images must be geometrically equalized and 8899, Emerging Technologies in the times and locations matched – preferably accurate to the level of the individual pixel. Security and Defence; and Quantum Security II; and Unmanned Sensor Fraunhofer IOSB is responsible for the principal task of the project “TV-IR fusion” which Systems X, 889919, http://dx.doi. also includes the registration process. org/10.1117/12.2028734, 2013 [3] Davis, J.; Sharma, V.: "Back- ground-Subtraction using Contour- The collaborative project INVIDEON aims to accelerate the introduction of the RTO concept based Fusion of Thermal and Visible and thus improve the efficiency of the air transport system. Imagery," Computer Vision and Image Understanding, Vol 106, No. 2-3, pp. 162-182, 2007
73 1
ROAD RECONSTRUCTION FOR SIMULATION TERRAIN DATABASES Supplementing vector data with information from aerial imagery
Virtual simulation systems have proven their practical value as tools for education and training as well as the preparation and evaluation of operations. Driven by rapid advances in hard- and software for com- puter game products, simulation systems are now becoming an interesting tool for education and training purposes in terms of immersivity, versatility and depth of simulation. While there is significant overlap between games and simulations used for entertainment, on the one hand, and those used in the profes- sional sphere, on the other hand, there are some major differences, especially in the elements used for didactic purposes. The provision of simulation terrain databases is another key difference. Fraunhofer IOSB is researching techniques for generating simulation data from various types of sensor data with a high level of automation. It has produced a number of process categories for reconstructing terrain forms, vegetation and building developments. The processing of information concerning road networks is a spe- cial case and described in greater detail below.
Background Even a successful simulation, which has been popular over several product generations, can survive throughout its life cycle with only minimum changes to its terrain databases. Well-known examples include combat flight simulations such as “Falcon”, “Flanker”, “IL2 Sturmovik” or “Digital Combat Simulator”. The original versions of these games were launched in the 1990s and their current iterations are still essentially based on the same terrain data. Simulations used by the military, in contrast, must have access to new terrain data for operations at short notice. It is even possible that they must be used with terrains to which they have no access but must still be recognizable.
Task Contact: The reconstruction of roads from aerial photographs has been a frequently and intensively Dipl.-Ing. Peter Solbrig addressed problem in the more recent history of geodesy, photogrammetry and remote Phone +49 7243 992-359 sensing. Until now, no automatic and universally reliable solution has been found. The data [email protected] used for research in this area is often taken from aerial photographs produced for land Scene Analysis surveys. However, when generating databases for military simulation systems, it has to be www.iosb.fraunhofer.de/SZA assumed that the data available will be of lower quality. However, the input data need not
74 2
1 View of a semantic 3D model (comprising ground, buildings and trees) with marked and verified road network. The be restricted to aerial or satellite images. The task is thus to derive an updated transport road network is based on freely network database using reconstruction, information fusion and all available data, e.g. vector available geographical data maps containing transport network information. while the 3D model was recon- structed and textured using cur- Results rent sensor data (drone videos). In principle, free data services around the globe mean that road network information in Minor and major deviations are the form of vector data is available. However, it must be assumed that there are gaps and highlighted in yellow and red, errors in the data. To mitigate these problems, Fraunhofer IOSB has developed methods respectively, while roads com- which make it possible to detect signs of roads using aerial photographs or videos, patible with the sensor data are e.g. captured by drones, and then use this information to correct or supplement existing highlighted in green. vector data. These signs can be derived both from photographic and 3D information 2 Sensor data (true orthophoto which can be calculated from photographs using modern reconstruction methods. The and elevation image, left and few uncertainties can be solved through integration into textured 3D models based either center) and the result of seg- on public domain data sources or current sensor data. ment-based classification (white and green: correctly/incorrectly In cases where no information was available, state-of-the-art classification processes were classified road segments, black used to perform the initial detection of roads. As many features can point to the presence and red: correctly/incorrectly of roads (low relative height, homogeneous, neutral color and texture, local planarity of classified non-road segments). the surface) but there are many exceptions for each of these features (bridges, conceal- ment, shadows, variety of road surfacing materials, etc.), rules-based approaches, e.g. threshold value decisions, are often ineffective. Project financed Basic/self-financed research Instead these features are usually gathered over all pixels or segments into feature vectors. Rules are then learned using training examples from similar data materials Project execution according to which a feature vector is assigned to the category “road” or “non-road”. As Dr.-Ing. Dimitri Bulatov, feature vectors can have any number of dimensions and considerable computing power Dipl.-Inform. Gisela Häufel, is required to calculate them, they should only be evaluated for some sections of the Dipl.-Ing. Peter Solbrig, training data. This procedure is known as feature or variable selection and may be highly Dipl.-Inform. Peter Wernerus dependent on the learning process. For example, up to 3/4 of all features can be catego- rized as redundant or irrelevant without significantly impairing classification accuracy.
Figure 2 above shows a typical result for segment-based road detection. The results can be improved even further by assigning neighboring instances (pixels or superpixels) to the same category with the assistance of a prior integrated into a complex optimization framework.
75 BUSINESS UNIT
SECURITY
Spokesperson Considering that new technologies are being discussed in a Dr.-Ing. Markus Müller controversial manner with respect to conflicting aspects of Phone +49 721 6091-250 security needs and the desire for freedom, particularly if they are associated with surveillance, IOSB pursues the notion of »Privacy by Design«, which requires that privacy criteria are already accounted for during the design of the system. Furthermore the protection of industrial installations and production capabilities against cyber-attacks in the context of the »Industry 4.0« paradigm continues to receive strong joint attention by IOSB’s Security and Automation business units.
The range of services extends from studies (e.g. for evaluation) to the realization of experimental systems or prototypes and, in individual cases, up to and including system development. Business Development In typical projects, the security researchers of Fraunhofer IOSB Dr.-Ing. Andreas Meissner support customers in their efforts to improve their competitive Phone +49 721 6091-402 position, addressing challenges previously considered too dif- ficult, enabling new product generations featuring innovations from the cutting edge of research.
Markets The business unit Security serves customers from the private and public sector. The former includes security technology providers, security service providers and operators of pro- perties with critical security profiles. IOSB serves authorities at the federal, state and municipal level in the public sector, including emergency services, which aim to identify and Mission evaluate new technologies in order to fulfill their duties. The business unit Security focuses on the security needs of people, companies and authorities, wishing to protect IOSB is available as a partner for specialized small and against natural and deliberate threats. It comprises a medium-sized companies as well as larger companies for broad range of interlinked competencies that deal with the development of product innovations. It considers itself sensor sphere and optronic aspects as well as multimodal as research resource for companies, which would also like surveillance robotics (on land, at sea and in the air), the to benefit from new scientific results without maintaining development of ultra-modern analytical methods, the sup- their own research department. Scientists often take on port of interoperable standards for the real-time exchange demanding subtasks in large projects on behalf of compa- of information for risk detection and management as well nies. System integrators integrate IOSB developments in their as assistance in the situational analysis and human machine systems, for example based on licenses. interaction in situation centers.
76 Prior to or after acquisition of their contracts, security service Equipment, laboratory and test facilities providers and IOSB discuss the possibilities for further increase • Comprehensive laboratory equipment for capturing the in the efficiency and/or effectiveness of their work by means of entire image processing chain, from sensors through analysis to interoperable information exchange using new technologies; if necessary, IOSB involves industrial • Innovative, powerful sensors, such as eye-safe gated viewing partners for commercial development and 24/7 support of lasers, two-color infrared sensors, multi- and hyperspectral the systems. Providers of novel high-tech products, who want sensors, and remotely-sited laser vibrometry systems to offer their own customers assurance with respect to their • Distributed test setups for multi-camera tracking and performance claims, commission IOSB with lab evaluation privacy-compliant video analysis in public spaces and benchmarking tests, on the basis of which absolute and/ • Multimodal sensor platforms: Experimental robotics on land, at sea and in the air, and associated ground control stations or relative conclusions relating to performance can be drawn. (stationary and in vehicles) for mission planning and control IOSB experts offer consultation to companies or authorities in heterogeneous deployment networks while they prepare invitations to tender for security systems, • Experimental counter UAS system particularly when it comes to the issue of relevant new technologies. This particularly includes the evaluation of tech- Recent Security Research Projects include: nologies with respect to their suitability for certain objectives. • A secure, modular and distributed mobile border control solution for European land border crossing points (MobilePass) Companies that intend to resort to publicly funded research • A harmonized, modular reference system for all European automated border crossing points (FastPass) projects in order to enhance their portfolio receive assistance • Innovative tools for the detection and mitigation of CBRN by IOSB when it comes to identifying suitable funding related contamination events of drinking water (SAFEWATER) programs and to preparing a proposal. During the course of • Surveillance: Ethical Issues, Legal Limitations, and Efficiency a project, IOSB acts as a research partner. Furthermore, IOSB (SURVEILLE) finds funding programs and suitable partners from industry for • Prevention, protection and REaction to CYber attackS to users in search of new technologies for their fields of activity. critical InfrastructurEs (PRECYSE) • Security and interoperability in next generation PPDR communication infrastructures (SALUS) In a technological respect and according to the overall • Multi Sensor Based Recognition of Criminals in Crowds research proposition of Fraunhofer IOSB, methods and sys- during Complex Police Missions (Muskat) tems for image exploitation are a core area, which are deve- • More Security for Soccer Events - Improving Communications loped for property surveillance in both indoor and outdoor and Optimizing Dialogue (SiKomFan) areas. With its competencies, IOSB handles the entire chain • Multi Biometry Based Forensic People Search in Mass Image from sensor-sphere data acquisition, sensor carriers and their and Video Data (MisPel) automatic control for surveillance missions, analysis on an • Co-operative System Platform for Video Upload, automatic or human-machine basis, multi sensor fusion, and Assessment, Semiautomatic Analysis and Archiving (PERFORMANCE) situation analysis up to and including the use of information • Autonomy Kit for close-to-production Vehicles supporting acquired in this manner for higher-level management Networked and Assisted Recovery of HazMat (AKIT) support. Recently Counter UAS (unmanned aircraft systems) • Flexible Semiautomatic Exploitation of Mass Video Data research and development activities have been high on IOSB’s (FLORIDA) agenda. System design in compliance with privacy protection • Assistance System for the Situation Aware Defense of is an explicit topic of research and part of the consulting Danger through Unmanned Aerial Systems (ArGUS) portfolio of the business unit Security.
77 1
PRIVACY-RESPECTING VIDEO SURVEILLANCE Making video surveillance respect users’ privacy while increasing security in public places
Privacy-respecting video surveillance introduces a conceptual framework for lawful, smart video surveillance that enforces privacy-related constraints based on the current threat situation and the type of incident that has been detected. It constitutes the first step towards situation-dependent smart video surveillance and helps to increase security while protecting the observed peoples’ privacy.
Task description Video surveillance systems are a powerful tool for improving public security and the prosecu- tion of crime. So-called smart video surveillance systems support the operator in evaluating video data. Image processing algorithms process captured live data and search for critical events, e.g., violence. Systems such as these are making video analysis algorithms for activity recognition, tracking, and biometric identification of persons a reality. However, while these developments aim to improve the effectiveness and efficiency of video surveillance, they coincidentally increase the diversity and intensity of intrusions into the observed individuals’ privacy and create new potential for misuse. Legal scholars agree that applicable data protec- tion laws, i.e. the German Federal Data Protection Act (BDSG) or the European General Data Protection Regulation (GDPR), do not sufficiently cover the technological evolution of smart video surveillance and demand further regulations. In this sense, they expect that the lawful operation of smart video surveillance will require effective mechanisms for protecting privacy and preventing misuse.
Result description To cope with the privacy risk while still increasing security, Fraunhofer IOSB has developed a generic privacy-aware video surveillance architecture that operates in three distinct modes [1].
The ‘Default Mode’ is active most of the time. In this mode, no critical activity is observed Contact: and therefore the impact on privacy must be limited. The operator has only limited access to Dr.-Ing. Erik Krempel information and functionality, e.g., all video data is artificially pixelated. ‘Assessment Mode’ is Phone +49 721 6091-292 activated once an algorithm, e.g., violence detection, or the operator raises an alarm. In this [email protected] mode, the first indicators for a critical incident have been detected. The operator has access Interactive Analysis and Diagnosis to extended information, e.g., high quality video streams, to assess the situation. ‘Investiga- www.iosb.fraunhofer.de/IAD tion Mode’ is activated once a suspected incident is confirmed. In this mode, a given event
78 2
1 An operator uses the video archive to find the owner of a piece of luggage. 2 NurseEye data processing.
Project execution Dr.-Ing. Erik Krempel; Dr.-Ing. Pascal Birnstill has been assessed as critical. The operator may therefore use the highest level of functionality to prevent further damage. Algorithms with a high privacy impact, e.g., automatic person tracking and biometric identification become available. Once the incident is resolved, the system changes back to ‘Default Mode’.
Project description This generic architecture has been adapted to different scenarios. In the security-related scenario “Unattended Luggage” a smart video surveillance system is deployed at an airport. In ‘Default Mode’, video is captured and stored in a 24-hour archive that is not accessible by the operator. Additionally, an algorithm searches for unattended pieces of luggage. If one is detected, the algorithm activates the ‘Assessment Mode’ and alerts the operator. If the operator confirms the alarm, the ‘Investigation Mode’ is unlocked. Here, the operator has access to the video recordings of the last 15 minutes and can use them to find the person who dropped the piece of luggage. Once the operator has found the person, he activates a tracking algorithm that reconstructs where the owner went after abandoning the luggage. Depending on the results, the operator decides if the area must be evacuated, e.g. the owner left the area in a hurry, or if a security officer should inform the owner about his left behind luggage, e.g. in case the owner went to a nearby kiosk. Once the incident has been resolved, the system is set back into its ‘Default Mode’.
In the safety-related “NurseEye” scenario, the system operates in nursing homes or hospitals [2]. In ‘Default Mode’, an algorithm designed to detect people falling to the floor processes Literature [1] Birnstill, P.: “Privacy-Respecting all video data. If no fall occurs, the system deletes the video data immediately. If the system Smart Video Surveillance Based believes a fall has occurred, it activates the ‘Assessment Mode’. First, the nearest member of on Usage Control Enforcement”, Dissertation, Karlsruher Schriften the nursing staff receives an alarm on his smartphone. When he accepts the alarm, the staff zur Anthropomatik, member is granted access to an anonymized video so he can check whether there is an actual ISBN 9783731505389, 2016 emergency. If the alarm is confirmed, the system enters ‘Investigation Mode’. Here, the nurse [2] Krempel, E.: “Steigerung der Akzeptanz von intelligenter Video- has full access to the live video data to assess the current situation and decide on the optimum überwachung in öffentlichen way to handle it, i.e. he decides if special equipment is needed. Once the faller has received Räumen”, Dissertation, Karlsruher Schriften zur Anthropomatik, help, the system returns to ‘Default Mode’ and deletes all the video data. ISBN 9783731505983, 2017
79 1
S²UCRE – SAFETY & SECURITY OF URBAN CROWDED ENVIRONMENTS Advanced Video-Based Crowd Monitoring for Large Public Events
Current video surveillance systems still lack the intelligent video and data analysis modules that decision makers require to maintain full situation awareness in urban crowd environments. Augmented views of the area, especially crowd density estimations and behavior predictions, would be of enormous benefit to decision makers at mass gatherings. The research project S2UCRE (Safety & Security of Urban Crowded Environments), funded by the German BMBF and the French ANR, aims to provide this capability. Fraunhofer IOSB is contributing its NEST-system [1], a research and prototype platform for distributed intelligent video-based monitoring, to the S2UCRE project. It is also extending the project’s functionality with interactive decision support using video-based crowd monitoring.
Sponsored by: BMBF Project description The research project S²UCRE addresses the area of mass gatherings in complex scenarios and distributed urban environments. In such situations, the crowd is often inhomogeneous in terms of its density and motion dynamics. In addition, pedestrians are distributed over large areas. Moni- toring events is a challenge for law enforcement agencies (LEAs) even without disturbances. It is difficult to respond quickly to accidents, offensive behavior or crowd densities that trap people and endanger lives (often referred to as “panic situations”); preemptive measures seem impossible.
Contact: To overcome these problems, the S²UCRE project aims to link crowd monitoring based on video Dr.-Ing. Erik Krempel analytics with simulation-based methods for short-term prediction of crowd behavior. Two specific Phone +49 721 6091-292 events have been selected as scenarios: the Hamburg Harbor Festival (1.5 million visitors in [email protected] three days) and the Cannstatter Wasen in Stuttgart (up to 4 million visitors). Furthermore, Interactive Analysis and Diagnosis S²UCRE intends to bridge the gap between the macro level of crowd monitoring and observation www.iosb.fraunhofer.de/IAD of individuals or groups when there are reasonable grounds for suspicion. The project’s research on five interdependent support technologies for LEAs, event organizers, security staff and rescue Sascha Voth M.Sc. teams will improve collaboration between the various stakeholders responsible for security. Phone +49 721 6091-583 Studies on human factors form an integral part of the technical work packages and thus [email protected] go beyond the level of accompanying research. In addition, a fundamental work package is Videoauswertesysteme dedicated to legal and ethical aspects. www.iosb.fraunhofer.de/VID The S²UCRE demonstrator will integrate the support technologies and thus provide proof of concept for the predictive analytics tools. In particular, this will explore ways to guide crowds www.s2ucre.de based on predictive simulation. The five technology areas are:
80 2
• Video-based crowd monitoring of distributed urban environments: crowd densities and 1 Overview of the concept crowd dynamics. and basic system components. • Short-term prediction of crowd behavior for fast and efficient evacuation. German partners are responsible • Semi-automated suspicious behavior analysis for security applications. for the red and French partners • Detection & (geo-) localization of perpetrators. for the blue components. • Self-localization of security and rescue team members and a communication platform for 2 Visualization of crowd geo-registered information exchange between security and rescue personnel. behavior in video streams and dynamic heat maps. In contrast to current projects, S²UCRE will not develop these technologies individually but focus research on integrating continuous workflows into a single system. This will combine real-time information on the current security and safety situation with a short-term simula- Project execution tion of the crowd behavior to prevent critical conditions arising. Dr.-Ing. Erik Krempel, S²UCRE envisions an integrated surveillance and prediction system that addresses safety and Sascha Voth M.Sc. security and is tested on concrete scenarios. Figure 1 shows the overall concept of S²UCRE. In addition, the diagram shows the synergies and logical connections between the components required for safety applications (red) and security applications (blue). The information flow and processing chain for safety scenarios is as follows: algorithms for video- based crowd monitoring and density estimation in the urban area (3) extract data and give them to short-term simulation for risk assessment (5). Here, geo-registered information on escape routes (4) and human factors analysis (2) are used to simulate evacuation scenarios. The results of (3) and (5) are displayed in the surveillance and prediction system (7) where they are assessed by human operators. In case of a critical situation, the human operator can send dedicated messages and action plans to security officers and rescue teams in the crowd (8), or the crowd itself (9). For security applications, the information flow is as follows: mobile cameras (6), and possibly drones (to be investigated) gather data that is displayed in the surveillance and prediction system (7) and observed by human operators. If the operators detect suspicious behavior, they activate the monitoring application in the surveillance and prediction system (7). The potential offender is then detected and tracked by the system (3).
Information on offenders can be handed over to mobile security forces enabling them to approach the right person (8). Specifically, this includes the geo-location and high-resolution images of the offenders. As shown in Figure 1, S²UCRE covers the complete process chain from monitoring crowded urban scenes, risk assessment and situation awareness using geo-located observations to short-term predictive simulations and visualization for decision makers (Figure 2). Literature In parallel, human operators use the sensor (camera) network for surveillance and can trigger [1] Monari, E.; Fischer, Y.; Anneken, M.: “NEST-CrowdControl response measures in case of reasonable suspicion. S²UCRE thus unifies two sets of system – Advanced Video-based Crowd requirements and concepts, safety and security, on one platform. Ethical and legal aspects (1) Monitoring for Large Public Events”. In Proc. of the 11th Future Security are evaluated in a separate work package that will focus on the security scenario. Conference., Berlin, Sept. 2015
81 CORE COMPETENCE OPTRONICS OPTRONICS
CORE COMPETENCE OPTRONICS OPTRONICS (OPT) device. The simulation uses high-quality image templates as a substitute for real-life scenes. Using advanced image processing, the templates are degraded to the extent that Competencies and portfolio the resulting image most closely resembles the image that the simulated imaging device would show of the scene. The Department of Optronics (OPT) develops methods for experimental and model-based performance evaluation and for The use of laser sensors is often limited by the safety optimization of passive and active optronic systems. Laboratory requirements associated with laser equipment. To estimate evaluation systems are being developed for infrared detector the hazard range of the laser sensor, the degree of reflection mosaics, thermal imaging equipment, image intensifier tubes of the laser radiation from the investigated object must also and laser sensors, taking into account perturbation and hard- be known. Both modeling and numerical calculation of the ening. Theoretical work related to novel evaluation methods reflection behavior of laser radiation on surfaces that are and variables have resulted, among other innovations, in new subject to statistical fluctuations – such as water surfaces – analytical range models and imaging simulation models. present a particular challenge. For this purpose, the dynamic water surface model IOSB_WOM has been developed and Our thermal range model IOSB_TRM4 allows a calculation of validated during field trials at open waters. the performance of scanning and rigid thermal imaging devices, and cameras in the VIS, NIR, SWIR and thermal IR spectral Novel sensing methods and components are being developed range. IOSB_TRM4 is continually adapted to current require- and implemented in newly build up prototypes. They include ments and equipped with new features: The current version gated viewing cameras and laser radars with heterodyne includes a batch mode, which enables the user to incorporate detection for determining 2D and 3D laser reflection signatures, the program in different software and simulation environments and 2D vibration signatures for target classification over long for the purpose of e.g. hardware optimization or development. distances.
For image simulation of sensors in static applications, the To obtain the 2D vibration signature, the laser beam scans simulation model SITOS(S) and OSIS have been developed. the target in X and Y direction. For each measuring point a These can be used to simulate real-life scenes from an imaging frequency analysis is performed. If the target vibrates (e.g. a
1 2
84 Core Competence Optronics Head of department: Dr. rer. nat. Helge Bürsing Phone +49 7243 992-446 [email protected]
www.iosb.fraunhofer.de/OPT
running drive unit) a micro Doppler shift is imprinted onto the 1, 2 Gated-viewing exposure laser beam. This allows vibrating targets to be located through of a ship with sliding gate tech- partial obstructions (vegetation, fog, camouflage nets, etc.) to nique in Figure 2 (3D image). analyze their vibration behavior. From the findings, conclusions 3 eSWIR images with and about the motorization of the objects can be drawn and their without illumination showing geometric shape partially reconstructed. New methods for contrast inversion in the measuring vibration signatures without a laser were developed recorded image. applying high speed cameras in different spectral regions. 4 Laser vibrometry for wind turbine inspection using a In addition, concepts for the protection from laser radiation tracking camera (in cooperation are being developed for optronic sensors, with a particular with OBJ). focus on protection against laser dazzling. 3 Projects • Laser radar demonstrators and methods for target classification • Use of laser vibrometry for remote diagnosis of mechanical structures • Analytical calculation, modeling (IOSB_TRM4), and experi- mental verification of the range performance of imaging sensor systems (passive and active) in the spectral range from UV to thermal infrared for military and civilian tasks • Image based evaluation of sensor performance (IOSB_OSIS) within a European effort to establish a common European model (ECOMOS) • Experimental performance evaluation of passive and active optronic sensors including the use of new sensors and 4 concepts with optimized data processing (see illumination depending contrast in image 3) • Eye protection against laser radiation (protection from dazzle and injury) • Influence of and protection from laser radiation on optronic sensors • Propagation phenomena of ultra-short laser pulses (femtoseconds) in atmosphere and in optical materials • Propagation of high energy laser radiation through atmosphere • Investigations on the use of laser radiation in maritime environments using a water surface model IOSB_WOM • Development of laser safety concepts
Core Competence Optronics 85 SIGNATORICS (SIG)
Expertise and portfolio
The work of the SIGNATORICS (SIG) department focuses on Work in the field of signature management focuses on two the following main areas: different aspects. On the one hand, it develops techniques • Environmental limitations of EO/IR systems and methods to improve own camouflage and reduce • Warning sensor technology signatures. The objective is to reduce detectability and thus • Signature assessment and management improve survivability and mission success. On the other hand, it researches ways to overcome camouflage, concealment Understanding the interactions between system performance and deception measures by possible opponents. and environmental / atmospheric conditions is a core mission of our research. Thus the characterization of the environment The planning and the conducting of field trials are important is an essential task. The department essentially deals with sys- aspects of our work. We develop and use ground-, sea- and tems operating within the ultraviolet to the infrared spectral air-based sensor systems and measurement techniques to band. As well as identifying adverse environmental effects, the do this. We also work with satellite-based sensor systems. department also develops methods to overcome or mitigate Relevant material and system properties are identified with these limitations. the help of innovative laboratory equipment and related methods. The use and development of numerical simulations The department develops, assesses and optimizes warning completes the department’s portfolio. sensors for both military and civil applications. Profound knowledge of threat signatures and backgrounds is a key component of these tasks. Consequently, it is vital to gather information regarding potential threats.
1 2
86 Core Competence Optronics Head of department: Dr. rer. nat. Karin Stein Phone +49 7243 992-114 [email protected]
www.iosb.fraunhofer.de/SIG
1 Firing of a surface-to-air missile from a tank. 2 Analysis of environmental phenomena. 3 Measurement setup for BRDF Competencies of the department: determination. 4 Adaptive optics testbed for • Innovative warning sensor technology for the military and atmospheric turbulence correction. the civilian sector; • Prototype realization with the use of optical, electronic and mechanical design tools; • Sensor design for satellite-based monitoring systems; 3 • Characterization of environment and atmosphere; • Development of measurement methods and equipment; • Identification of adverse effects and development of corresponding mitigation methods; • Design and realization of innovative adaptive optics systems; • Algorithm engineering for real-time image correction; • Development, testing and evaluation of multi-spectral signature management approaches and deception measures; • Field trials in maritime and terrestrial environments with passive and active, ground- and air-based sensors ; • Identification of optical properties of materials within the full spectral range; • Design and development of analytical models and nume- rical simulations for radiation transport and propagation processes.
4
Core Competence Optronics 87 LASER TECHNOLOGY (LAS)
Competencies and portfolio
The new Department of Laser Technology (LAS) created in Being available to the other departments at IOSB, the novel 2018 is devoted to research and development of specific sources developed by LAS enable further research, develop- photonic materials and components, related laser sources ment and expertise in Optronics and Photonics applications and non-linear converters for the development and optimi- like performance evaluation of passive and active optronic zation of laser systems in the NIR, SWIR, MWIR and LWIR sensors and protection at IOSB. spectral range, focussing on the specific demands posed by optronic applications. Projects
Based on our competences in rare-earth (e.g. Erbium Er3+, • 1.6 µm Erbium lasers, e.g. for ranging and gated viewing Thulium Tm3+, Holmium Ho3+) and transition-metal (Chromium • 2 µm Thulium and Holmium fiber lasers in continuous Cr2+) doped laser materials and source architectures, we wave and pulsed regimes develop SWIR and MWIR solid-state and fiber lasers and rela- • 2.1 µm solid-state lasers with scaled pulse energy ted components. These lasers can be used as direct emitters • 3.9 µm Holmium-based fiber lasers in typical applications like communication, illumination and • Non-linear converters in the MWIR and LWIR spectral range metrology or are optimized for pumping non-linear converters. based on solid-state and fiber non-linear materials • Analytical and numerical modeling and experimental Experimental activities are in high-power cw and pulsed 2 µm verification of laser dynamics and resonator performance fiber lasers, components and architectures, pulsed 1.6 µm and 2.1 µm high-pulse-energy solid-state lasers and direct-emitting MWIR fiber lasers. Novel components are being developed, implemented and tested in laboratory setups to enable power scaling and adding functionality to new laser systems. They include fiber couplers and spliced components for SWIR and MWIR fibers, novel laser materials and resonator geometries.
Based upon our laser sources we investigate non-linear con- verter materials and develop and optimize architectures for MWIR and LWIR sources with specifically adapted properties for optronic applications.
Theoretical work is related to modelling of complex laser dynamics and novel resonator schemes for enhanced beam quality operation of high-average-power lasers and non- linear converters.
88 Core Competence Optronics Head of department: Dr. Christelle Kieleck Phone +49 7243 992-310 [email protected]
www.iosb.fraunhofer.de/LAS
1 Test arrangement for Holmium- doped fiber laser. 2 Non-linear conversion crystals for MWIR and LWIR applications.
1
2
Core Competence Optronics 89 VISUAL INSPECTION SYSTEMS (SPR)
Competencies and portfolio
The Visual Inspection Systems (SPR) department develops The department operates an image exploitation center and a and delivers systems for automatic visual inspection tasks cross-application multi-sensor lab with experimental apparatus in industry. The main areas of application are currently the for process clarification as well as development systems for automatic sorting of bulk goods in recycling, mining and a variety of application areas. In the hyperspectral imaging food industry (e.g. waste glass, metals, ores, diamonds, tea, laboratory, materials can be inspected within the wavelength herbs, coffee beans, grains, and seed), the inspection of sur- range from ultraviolet (UV) up to and including near infrared faces for defects (e.g. paint coat inspection), the inspection (NIR) in order to obtain optimal decision-making criteria for and characterization of transparent materials of all various the inspection task. The work group for multispectral data shapes (e.g. flat glass, headlight glass, and sunroofs), color analysis coordinated by SPR has strong experience in the field measurement of granulates and inspection of blister packs. of hyperspectral imaging.
All these applications are characterized by the fact that the Projects and products inspection is performed at high throughput rates inline with the higher-level process, which thus requires high-performance • VisioChromHR: Image exploitation system for automatic image exploitation systems. High-resolution line scan cameras inspection of tablet blisters of various types (color, grayscale, UV, and imaging NIR), 3D • Clarity: Image exploitation system for automatic sorting area array sensors or laser scanners are used as imaging sen- of waste glass shards sors.The image acquisition equipment is individually tailored • ClarityHR: Image exploitation system for automatic sorting to the specific task at hand, making particular use of folded of heat-resistant glass beam paths and LED flash illumination. • ClarityLead: Image exploitation system for automatic sorting of lead-containing glass The system platform for solving application tasks consists of • Minexx: Image exploitation system for automatic sorting standard PCs based on the PCIexpress bus under the Windows 7 of minerals and Windows embedded OS. The system’s high processing • FoodControlHR: High-resolution image exploitation power is achieved with specially developed framegrabber system for automatic purification of tea, herbs and dried for the PCIexpress bus. Together with a real-time system of vegetables algorithms for the acquisition and exploitation of images, • CoffeeControl: Double-sided image exploitation system for this platform is at the core of the delivered application systems. automatic sorting of coffee • WheatControl: Image exploitation system for automatically The department’s products are used in industrial applications cleaning grains around the world. Partnered companies are responsible for • GranuControl: Image exploitation system for automatic marketing and service. In some cases, however, the department sorting of plastic granulates develops directly for end users and takes care of installation • SpotInspect: Image exploitation system for automatically and service in the process. detecting contamination in a material flow
90 Core Competence Optronics Head of department: Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 [email protected]
www.iosb.fraunhofer.de/SPR
1 Food Inspection.
• Purity: Image exploitation system for detecting defects as In addition to cameras and lighting equipment, they include: air bubbles or inclusions in arbitrarily-shaped transparent materials (e.g. flat glass, curved glass, lenses, or granulate) • Sliding stages with a variety of different lighting fixtures for • Purity tension: Image exploitation system for detecting image acquisition defects and measuring tension in arbitrarily-shaped • Experimental systems for sorting bulk goods (each equipped transparent materials with a camera and blow-off device) in various configurations • WindShield Inspection: Inline image exploitation system as a belt sorter, sorter with chute and free-fall sorting for detecting defects in windshields • Measurement stations for inspecting surfaces • Measurement setup for 3D inspection Infrastructure and equipment • System for transparent materials • Hyperspectral Imaging Laboratory (240 – 2500 nm) Image exploitation systems for industrial visual inspection are • Lab equipment for material characterization application-specific or customer-specific. This is why almost • Sorting container for fast prototype production all research projects start with the question of whether the • Cleanroom for inspecting sensible parts respective task can be solved at all using an machine vision system? Subsequently, the limits of the inspection accuracy The methods used for image exploitation permit evaluation are determined. Eventually, an estimation of the resource of shape, texture, color, specular reflection, spectral properties requirement for system realization is performed. Satisfactory and 3D characteristics of the specimens. answers to these questions can be obtained only through experiments, which tend to be costly and time-consuming.
The image image analysis center and the cross-application 1 multi-sensor lab of the IOSB were set up for the purpose of experimental procedure clarification with, if applicable, the involvement of other IOSB departments and the and different KIT research groups. The image exploitation center and the multi-sensor lab offer numerous facilities for image acquisition and exploitation.
Core Competence Optronics 91 CORE COMPETENCE SYSTEM TECHNOLOGIES SYSTEM TECHNOLOGIES
CORE COMPETENCE SYSTEM TECHNOLOGIES ENERGY (NRG)
Expertise and portfolio Energy systems and components • System engineering and small power generators The German and European energy supply is facing major • Components for efficient energy use challenges: Renewable energy is only one aspect of the • Local energy storage and grid protection elements current structural changes to the energy system. Energy • Automation devices and safe IT components efficiency and cross-cutting issues such as electric mobility, • Power grid simulation and planning power analyzes, forecasts, virtual power plants and energy • Smart grids storage are gaining importance through the interconnected • Grid system management optimization and adaptive grid european power system. Fraunhofer IOSB-AST, department protection energy, has in all these areas extensive knowledge which is • Grid integration of energy storages and E-Mobility applied in various projects over fifteen years. • Safe IT infrastructure of smart grid
In the industrial sector, the software solution EMS-EDM Energy Business and System Analysis PROPHET® is successfully represented in the energy market • Liberalized energy markets and business models by major partners such as Compello GmbH. Here topics such • Market processes and communication as energy and energy data management are at the forefront. • Smart metering In energy research, more foreward-looking issues like cross- • Energy business analysis energy-management, energy storages, wind power forecast • Development of forecasting and optimization methods technologies or the integration of renewable energy into the power grid are explored. The department energy consists of IT-Cybersecurity for critical infrastructure energy & water five working groups: • Attack anatomy and attack scenarios • Law of critical infrastructures Software systems for energy technology and energy • IT security management business • Standard procedures and guidelines • Project management and consulting • Employee awareness • Forecast of renewable energy demand and feed-in • Supply optimization in liberalized markets Tasks and Projects • Optimization of energy processes • ADELE ING - Adiabatic compressed-air energy storage • Balancing group and grid utilization management (CAES) for electricity supply (BMWi, Energy Storage • Software solution EMS-EDM PROPHET® Funding Initiative) • Implementation of forecasting and optimization methods • Smart Region Pellworm – Energy storage integration into a • Market regulations support (MaBiS, KoV IV) virtual power plant (VPP) • Open, cross-system IT-Architecture • ICT energy lab - research and development platform for • Scalable, high performance client / server systems analysis and development of IuK technologies for centralized Core and decentralized intelligent energy supply systems and training center for EMS-EDM PROPHET®
94 Core Competence System Technologies Head of department: Prof. Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 [email protected]
www.iosb.fraunhofer.de/AST
1 Research project VEREDELE FACDS - Interdependency ana- lysis of flexible AC distribution grids. • EMS-EDM PROPHET® - energy management with forecast 2 Trainings within the and optimization as well as energy data management for Fraunhofer Academy Initiative liberalized energy markets „Learning lab cyber security“. • Demand analysis energy storage 2 - The impact of the distributed power generation for electricity generation and evaluation of energy balancing technology (BAES2, BMWi) • EBITA - Exploiting the Scientific and Business Potential when Integrating Smart Data Analytics into Internet of Things applications • REGEES: Renewable electrical energy system – Reg-EESystem - 100 % integration of renewable power in 2030 (BMWi) • VEREDELE FACDS - Robust control and feedback control systems of distribution power grids with a high proportion of fluctuating power production and fl exible loads with the approach of flexible AC distribution systems (BMWi) • DynaGrid Control Center - Extension of conventional transmission power control systems to future-proof, dynamic control rooms (BMWi) • sMobiliTy: COMMERCIAL - Optimization for a predictive, 1 power grid and power-market-driven load management • Feasibility study: Energy efficient industrial zone Erfurt (Industry) • Study EE-GEW; Energy efficient manufacturing business areas - smart building control technologies for commercial real estate for energy-efficient overall energy supply • ZAYED – Capacity for Renewable Energies (ZAYED funding program) • Training center IT-cybersecurity - critical infrastructures / applications for energy and water infrastructures (Fraunhofer academy / BMWi) • Scientific accompanying research in the esearchr field "Energy in buildings and neighborhoods" - Subprojects: Scientific accompanying research in the fields of power 2 grid and decentralized energy systems (BMWi)
Core Competence System Technologies 95 WATER AND MOBILE SYSTEMS (WMS)
Expertise and portfolio
The department water and mobile systems is engaged in the • Modeling, simulation and optimization of surface water field of holistic and integrated consideration of water supply systems systems, the development of embedded systems, assistance • Flash flood warning systems systems, and autonomously driven land and underwater • Water demand forecast vehicles. The department is split into three working groups: Tasks and Projects Embedded systems • Otto Bock Mobility Solutions GmbH: remote data logger • Integration of embedded systems • DAIMLER AG: Temperature transmission and CAN module • Embedded control and regulation systems temperature • System design and modules for autonomous vehicles • Stadtwerke Marburg: HydroDyn industry project water • Hardware integration distribution • Guiding systems for vehicles • HAPPI: small hydro power plant – evaluation of the poten- • Maintenance and diagnostic systems tial of climate protection and improvement by intelligent • Sensor data fusion and simulation technology • MoMo III: Integrated Water Resources Management for Water supply and wastewater treatment Central Asia: Model Region Mongolia Phase 3 • Drinking water abstraction • ABB Projects: Abu Dhabi, Mina Abdullah, Hafar al Batin, • Drinking water treatment New Cairo Taif Baha, Ras Alzaur Pipeline System • Drinking water distribution • INAPRO - Innovative model & demonstration based • Reservoir and dam systems water management for resource efficiency in integrated • Wastewater collection multitrophic aquaculture and horticulture systems Core • Wastewater treatment Competence System Technologies 91 • Sludge treatment • MoSiOp - Model Based Simulation and optimization of a • Recycling of wastewater UV-LED based emitter module • UV-LED AnPHOS - Monitoring and control concept and Maritime systems and surface water conversion into control electronics for high-performance • Simulation and guiding software for underwater vehicles UV-LEDs • Design, engineering and construction of underwater • Fraunhofer 4D: DeDAvE: Deep Diving autonomous under- vehicles and compression-proof modules water vehicle for exploration • Virtual test environment for simulation of mobile systems • iDeWaS - CLIENT II: International partnerships for sustai- and evaluation of vehicle guidance strategies nable Innovation - Definition project: smart decentralized • Control functions for the automated inspection of under- water systems water infrastructure, sea cables and pipelines
96 Core Competence System Technologies Head of department: Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 [email protected]
www.iosb.fraunhofer.de/AST
1 Underwater vehicle based on the C-Watch platform for a chinese customer. 2 Technology platform for autonomous robot vehicles: • ReStMuLa UV - Control algorithms and control electronics QUANJO TDS. for multi-lambda UV lighting units with low power consumption • DeOWa – Design and optimization of scalable UV-LED water disinfection reactors • AKIT - Autonomy kit for close-to-production construction machinery for connected and assisted rescue of hazards • SYTECH: Fish farming, FAMSUN 1 • Bischoff Elektronik GmbH: Adapter assembly and test program for final circuit board tests • Neways Technolgie GmbH: Evaluation and optimization of a firmware for charging cables • Atlas Elektronik: AUV-Flare catch control • C-Watch follow up projects in China: ROV-BWSTI, ROV-CAU • Kraken: DEDAVE AUV was sold to Kraken Sonar Inc. (Canada), long-time R&D-License agreement with Kraken Sonar Inc.
2
Core Competence System Technologies 97 INFORMATION MANAGEMENT AND PRODUCTION CONTROL (ILT)
The objective of the department Information Management action, e.g. for early warning systems of natural hazards. and Production Control (ILT) is to develop components and For the Industrial Internet of Things (IIoT) we design and complete solutions for the design, operation and maintenance implement smart solutions for the efficient search and of complex information, control and test systems. Security processing of heterogeneous data sets (“big data”), the requirements are analyzed according to customers’ needs extraction of knowledge with data mining methods (incl. and considered by design. Our focus lies on the following semantic annotation) and the fusion of heterogeneous application domains of the Internet of Things (IoT): industrial sensor data to meaningful technical information for decision production, environment, health, risk management, resource support (“Fusion4Decision”). We develop and use innovative efficiency and security. methodologies for the systematic analysis of user and system requirements including IT security, and design problem- On the basis of agile methods in requirements analysis, specific service-oriented and event-driven architectures. system design and recognized architectural and commu- We develop thematic applications and connect them to nication standards, we implement open, innovative, and integrated environmental information systems. We are customized software solutions, encompassing and driving responsible for the reference use case in production in the new paradigms of the “(Industrial) Internet of Things” as Industrial Data Space initiative. well as “Industrie 4.0”. In order to accompany and support our customers on this way, we offer dedicated consultancy Our software framework WaterFrame® renders data sources and training services, e.g. enterprise-specific Industrie 4.0 accessible and integrates geographical information system roadmaps, use of standard technologies, the transformation (GIS) components as well as innovative geostatistical methods. of Manufacturing Execution Systems (MES) to the require- WaterFrame® supports the generation of thematic maps, ments and technologies of connected smart factories. diagrams and reports.
We analyze the suitability of modeling and communication With the ProVis suite we realize production control system methods and IT security technologies for: components and integrated solutions according to both the • complex manufacturing processes driven by Industrie 4.0 classical functional MES requirements, and the emerging value chains (e.g. plug-and-work based upon IIoT / Industrie 4.0 paradigms encompassing demanding IT AutomationML and OPC UA) security features such as intrusion detection services and • environmental sensors and observations secure communication. (geospatial standards of the Open Geospatial Consortium OGC such as the SensorThings API) The functions offered by ProVis range from monitoring and managing production facilities up to engineering control Our information management system “WebGenesis®” rooms and the processes of manufacturing control. This supports ontology-driven Web-based information systems, allows us to deploy production control systems in automotive problem-specific data analysis and personalized user inter- production sites and the steel industry, including Web-based
98 Core Competence System Technologies Head of department: Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 [email protected]
www.iosb.fraunhofer.de/ILT
data analytics and reporting systems. We run vulnerability tests Infrastructure for production systems and critical infrastructures, and develop test systems for selected standards such as Foundation Fieldbus, • ProVis – integration and test facility AutomationML, and HLA. Dipl.-Inform. Gerhard Sutschet Phone +49 721 6091-370 Our technologies are integrated into the IT Security Lab for [email protected] Industrial Production of IOSB. Our objective is to provide train- • Industrie 4.0 Model Factory and AutomationML test center ing for new technologies, promote the adoption of standards Dr. Ljiljana Stojanovic in the market and to support interoperability in open systems. Phone +49 721 6091-287 We therefore actively participate in the Standardization Council [email protected] Industrie 4.0 (SCI4.0) and other relevant standardization bodies • IT Security Lab such as VDI/VDE, DKE, DIN, IEC, IIC, W3C and OGC. Dr.-Ing. Christian Haas Phone +49 721 6091-605 Products [email protected] • WebGenesis® – Web-based information and knowledge • Smart Factory Web – IIC testbed enabling marketplaces and management solutions for applications in the environment, interconnectivity of smart factories traffic and automation sectors and for the documentation Dr. Kym Watson of research projects Phone +49 721 6091-486 • WaterFrame® – Java framework for the development of the- [email protected] matic applications and environmental information systems • WaterFrame®– integration and test facility • SensorThings API – open source implementation of the light- Dipl.-Ing. Jörg Stumpp weight OGC standard to manage sensors and sensor data Phone +49 721 6091-259 • ProVis.Agent®/Visu® – agent-based production control [email protected] and visualization system for managing and monitoring • Environmental Sensor Network INSENSUM automated production facilities Dr.-Ing. Siegbert Kunz • ProVis.Paula – production and plant data evaluation system Phone +49 721 6091-600 with data mining components [email protected] • OPC UA/AutomationML Toolset – User assistance ranging • Fieldbus Foundation conformance test center from graphical modelling, conversion support to plug-and- Dipl.-Ing. Michael Theis work-functionality Phone +49 721 6091-321 • AutomationML test system – Web-based conformance [email protected] testing of AutomationML descriptions, available online at • HLA simulation test center http://amltest.iosb.fraunhofer.de Dipl.-Inform. Reinhard Herzog • SERVUS – Web-based requirements engineering tool for Phone +49-721-6091-294 service-oriented analysis and design [email protected] • Network Calculus – methodology for the performance evaluation of communication networks • IsuTest – Industrial Security Testing Framework, open source vulnerability and robustness testing framework
Core Competence System Technologies 99 MACHINE INTELLIGENCE (MIT)
Competencies and portfolio
The Machine Intelligence (MIT) division at Fraunhofer IOSB-INA Topics | Research areas: applies machine intelligence to production and automation solutions. It focuses on the preparation and analysis of • Big data infrastructures (parallel and distributed systems) production-relevant data using techniques from the areas of • Interoperability frameworks (e.g. OPC UA) big data and machine learning, the use of knowledge-based models for diagnostics and optimization as well as assistance Based on these Big Data platforms, the Machine Learning systems to facilitate interaction and collaboration, e.g. in group is dedicated to developing processes and algorithms assembly systems. which analyze data for applications such as condition monitoring, predictive maintenance, diagnostics and optimi- The Machine Intelligence (MIT) division at Fraunhofer IOSB- zation. This involves structuring large volumes of data and INA researches and develops industrially viable solutions mapping them in computer-aided models and simulations. which enable people to master and control the complex These models can then be used to formulate predictions production environments of both today and the future. This about the behaviors of real processes, ensure the integrity of includes standardized data management from collection to systems or forecast equipment condition and maintenance analysis and application, the use of machine learning tech- requirements. These cognitive assistance systems always niques to harvest valuable information from large volumes aim to reduce the complexity of the large volumes of data of data, the development of algorithms for diagnostics and generated by production environments and make them more optimization, and assistance systems which are the interface manageable and meaningful for the user. to human operators. The aim is to enhance the quality of the support provided to the user by the automation, i.e. making Topics | Research areas: it more intelligent. • Machine learning It is in this context that the group Big Data Platforms • Model-based design methods addresses the challenges of standardized data collection and • Optimization methods management. In the first stage of Industry 4.0, communica- • Knowledge-based system diagnostics tion aims to standardize the collection of data in production environment and enrich it with metadata and contextual The Assistance Systems group in the Machine Intelligence information. As in the area of cybersecurity, Industry 4.0 division researches and develops physical assistance systems communication is a multifaceted topic which affects every which act as the direct user interface in the value chain for aspect of the value chain. The aim is to enable systems used industrial automation and process digitization. The production by different manufacturers and sectors to work together and data processed for evaluation and application at the end to create a framework for handling large volumes of data. of the value chain now flow into technical solutions which Here, big data platforms function as a standard platform for make working and interacting with automated systems in storing and evaluating data. industrial environments more ergonomic, secure and flexible.
100 Core Competence System Technologies Head of department: Prof. Dr. rer. nat. Oliver Niggemann Phone +49 5261 94290-42 [email protected]
www.iosb-ina.fraunhofer.de
1 Machine Learning: algorithms tapping into the knowledge hidden in Big Data. 2 Remote support: decentra- lised operation and supervision These assistance systems are not only used in the operation, of assistance systems. maintenance and repair of machinery and equipment but also in providing digital support for manual manufacturing and assembly processes.
Topics | Research areas:
• User experience studies 1 • Usability tests • Information and interaction design • Development of UI prototypes • Process development and support
2
Core Competence System Technologies 101 DIGITAL INFRASTRUCTURE (DIS)
Competencies and portfolio
The Digital Infrastructure (DIS) division at Fraunhofer The Industrial Internet / IoT group within the DIS division IOSB-INA researches and develops technical solutions and researches and develops network solutions for structuring environments for the industrial automation and applications and transferring information in real-time. Flexibility, inter- which is situated at the heart of Industry 4.0. Research and operability, speed and intelligent network controls are at the development are focussing on technologies for recording core of the network architectures which are the foundation physical measurements using intelligent sensors, the of the industrial Internet. construction of reliable networks based on communication systems and internet technologies with real-time capabilities, Topics | Research areas: and cybersecurity solutions. From smart sensor systems in machinery and equipment to real-time data processing • Industrial Internet / IoT and the construction of software-controlled networks with • Real-time Ethernet, industrial wireless and real-time flexible and integrative protocols, DIS is engaged in building middleware the foundations and developing the architecture for the • Network management “Internet of Things” in the context of industrial production. • Solutions for system integration
The Digital Infrastructure (DIS) division at Fraunhofer IOSB-INA Securing networked technical systems against cyber-attacks researches and develops technical solutions for Industry 4.0 and eliminating security loopholes is a multifaceted topic applications in the integrated factory environments of the being researched by the Institute’s specialists in industrial future. automation. The Institute is developing courses and qualifi- cations in cybersecurity in partnership with the Ostwestfalen- The aim is to provide the right quality of information wherever Lippe University of Applied Sciences. These are particularly and whenever it is needed so that people, products and appropriate for small and medium sized enterprises and form machines can interact efficiently. part of the range of qualifications offered by the Fraunhofer Academy. To provide context-sensitive situation analysis, computer sys- tems must be able to monitor the physical-technical system Topics | Research areas: using sensor and localization systems. • Hard- and software development for securing critical Topics | Research areas: infrastructures in industrial environments • Training courses offered by the Cybersecurity Training Lab • Smart sensor systems • Indoor localization • Object recognition
102 Core Competence System Technologies Head of department: Prof. Dr.-Ing. Jürgen Jasperneite Phone +49 5261 94290-22 [email protected]
www.iosb-ina.fraunhofer.de
1 Security and real-time capability: basis for connecting the office with the shop floor for IoT applications. 1 Plug and Produce: Flexible and modular production to support high product variability.
1
2
Core Competence System Technologies 103 SYSTEMS FOR MEASUREMENT, CONTROL AND DIAGNOSIS (MRD)
Competencies and portfolio • Data analysis for technical processes --Performance and condition monitoring solutions for The acquisition and evaluation of sensory and other data plays complex industrial production processes a crucial role in many applications: in industry, sensory data, --Development, adaptation and application of methods for together with process models, establishes the basis for obtain- classification, machine learning, and data mining ing high-quality, universal functionality of products as well as --Machine learning methods for diagnosis and causality facilitating an optimal productivity of production facilities. analysis in technical systems • Information fusion A full understanding of the processing chain – from data --Multisensor fusion e.g. for robotic and automotive acquisition through processing and evaluation to optimization applications or feedback into the process, and always considering the --Dynamic information fusion using heterogeneous sources dynamics and other characteristics of the process – is essential (e.g. for environmental warning modules) also for other fields of application, such as environment --Fusion of image and geometry data for automotive, processes, robotics, automotive and civil security. In this robotic and surface inspection applications context the department Systems of Measurement, control • Image and signal processing and Diagnosis (MRD) offers the following core competencies: --Real-time image and signal processing --Defect detection on surfaces using adapted classification • Modeling and simulation methods -- Analytical, knowledge-based and data-driven modeling --Generation of 3D data (e.g. using deflectometry, -- Machine learning methods for modeling complex technical sidescan sonars, stereo cameras and other reconstruction processes methods) -- Modeling, simulation and synthesis for sensor systems --3D data and image processing for applications in --Block-oriented and finite element models robotics, automotive and surface inspection -- Simulation for virtual test drives of road vehicles (OCTANE) --Visual navigation for autonomously driving road vehicles -- Driver modeling using deep learning --Content-based image retrieval in very large databases • Measurement and sensor techniques with machine learning concepts --Advanced deflectometry methods for surface inspection • Robotics -- Image-based surface inspection techniques --Safe physical human-robot interaction -- Optical and imaging measurement concepts --Environment-interactive path and trajectory planning -- Automated microscopy --Simultaneous localization and mapping (SLAM) • Control and feedback control techniques --Advanced techniques for localization and mapping -- Model predictive and structure-variable control concepts in --Control of complex robotic kinematics process engineering and robotics --Robot control based on ROS middleware -- Process control using machine learning methods --Algorithm toolbox for autonomous mobile robots
104 Core Competence System Technologies Head of department: Dipl.-Ing. Christian Frey Phone +49 721 6091-332 [email protected]
www.iosb.fraunhofer.de/MRD
1 Robot systems for deconta- mination in hazardous environ- ments.
Applications and projects • Monitoring, control and optimization in process engineering -- Usability studies for driver assistance systems -- Model-based control in process engineering -- Solutions for estimation of weather und road surface -- Tools for online condition monitoring in chemical and conditions pharmaceutical industry -- Concepts for machine perception under adverse weather • Quality and productivity assurance for process and conditions manufacturing engineering -- Fog density estimation using intelligent structured -- Intuitive operator tools for process optimization spotlights -- Machine learning based tools for evaluating process and -- Aerial video analysis for building statistical models of the product data behavior of traffic participants -- Surface inspection systems for painted, specular and textured surfaces • Sensor systems -- Image-based sensor systems for online surface inspection -- Sensor systems for underwater robotic applications -- Automated microscopic inspection -- Automated real-time detection of toxic contaminations • Robot applications -- Solutions for autonomous service and inspection robots --Robotic applications in logistics and for security applications -- Precision farming and construction operations • Security and environment 1 -- Quality control for water supply systems and waste water disposal -- Energy monitoring and optimization for home applications -- Security concepts for drinking water supply -- Robot-based exploration and mine clearance in former conflict areas • Automotive applications -- Visual navigation for autonomously driving road vehicles -- Concepts for building groups and alliances for cooperative driving -- Pedestrian detection in low resolution images -- Cyber security benchmarks for Car2Car communication
Core Competence System Technologies 105 CORE COMPETENCE IMAGE EXPLOITATION IMAGE EXPLOITATION
CORE COMPETENCE IMAGE EXPLOITATION INTERACTIVE ANALYSIS AND DIAGNOSIS (IAD)
Profile and competencies Accessing and processing personal identifiable information (PII) helps us to build attentive environments that react The department Interactive Analysis and Diagnosis (IAD) to human needs. Legal regulation, such as the European develops smart interactive environments and assistance sys- general data protection regulation (GDPR), demand a high tems to support people in various analysis and decision tasks. level of IT security and privacy protection whenever PII is These systems usually need to process large amounts of data, processed. IAD employs a group of IT security professionals, especially data of individual persons. To protect users from who develop their privacy expertise in research projects and the inappropriate use of their personal data, technologies for consult industry partners on how to incorporate privacy by privacy and security by design are investigated. design into their systems.
Smart environments, such as attentive and innovative Following solutions are currently provided: production environments, and assistive operating rooms or intelligent car interiors need innovative concepts for human Multimodal Human-Machine-Interaction machine interaction. The focus lies mainly on techniques • Camera-based face, head and body pose estimation, hand using camera- and video-based interaction methods, such and pointing gesture-recognition for intuitive human- as detecting and tracking persons, recognizing hand poses machine interfaces and pointing gestures, as well as analyzing activities and • Multimodal and natural Human-Machine-Interaction within supporting gaze-based interactions but also applying speech multi-display environments recognition systems. • Gaze-based interaction for video image analysis • Multi-person tracking and face identification for presence- Assistance systems support people in the process of aware and personalized, adaptive HMI solution decision-making. Application areas are image interpretation, • Interaction techniques for mobile augmented reality intelligent surveillance systems, manual assembly in produc- applications tion and medical diagnosis. Methods in the area of artificial • Industrial HMI, e.g. gesture based quality assurance and intelligence, e.g., machine learning and data mining, extract defect documentation relevant information from large quantities of data. Man- machine-interaction techniques enable us to develop user Assistance systems interfaces with a high usability. Therefore, human experts get • Situation recognition and anomaly detection for crisis the best support to make final decisions. management and security services • Medical expert systems Our concepts take into account the strengths of both com- • Intelligent workflow-analysis puter systems and humans. Computer systems are capable • Decision support systems of rapidly saving, searching and calculating large quantities • Knowledge discovery in large data bases of data. Humans, on the other hand, are still superior to computers when it comes to recognizing and interpreting IT security and Privacy by Design complex structures in a high amount of data. • Privacy by Design for interactive systems
108 Core Competence Image Exploitation Head of department: Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 721 6091-393 [email protected]
www.iosb.fraunhofer.de/IAD
1 Video-based passenger recognition for personalized assistance systems. • Privacy-aware smart video surveillance 2 Digital Map Table for team- • Data portability and data usage transparency oriented analysis of geographi- • User-Managed access for PII cal information.
The following products and projects are provided: • Digital Map Table – A multi-display workspace for computer-supported situation analysis • InCarIn – Recognizing the car interior’s passengers for intuitive, activity-aware and adaptive infotainment and comfort assistance functions 1 • PAKoS – Adaptive semi-autonomous driving by means of recognizing the activities and distractions of driver and passengers • RecceMan® – Interactive assistant for identification of objects and infrastructure • WiMAAS – Data Fusion in maritime wide area surveillance applications • MARISA – Maritime situation assessment and anomaly detection for supporting situation awareness of decision makers • FastPass – Optimizing the waiting time at border control stations • KonsensOP – A context-based assistance for a medical team in an operating room 2 • OnkoLeit – A medical expert system following clinical practical guidelines for diagnosis, treatment and follow-up of oncological diseases • ArGUS – Assistance system for countermeasures in UAV-attacks • KASTEL – Competence center for applied IT security • SecureAutoType – Secure and user-friendly password management • ASARob – An awareness sensitive robot for intuitive human-robot interaction • S2UCRE – Advanced video-based crowd monitoring and decision support for large public events
Core Competence Image Exploitation 109 INTEROPERABILITY AND ASSISTANCE SYSTEMS (IAS)
Competencies and portfolio
The department Interoperability and Assistance Systems (IAS) The work includes the design, implementation and evaluation offers solutions to the market in which the interaction of of system solutions for interactive sensor data analysis, people with complex information systems plays the key role. knowledge creation and integration of knowledge into expert In a “system of systems” approach interoperability is vital. systems to support networked data analysis, the modeling of users, workflows and application domains, as well as compe- With research and development projects in the field of soft- tence management in distributed systems. Laboratory and field ware architecture for computer-based assistance systems experiments on demonstrators and operational systems are with a focus on dialog design and semantic interoperability, performed to optimize system performance and to evaluate we contribute to the technical and content networking of human-machine communication. In addition to developing systems. By designing dialogs that are adapted to the users basic system architectures that promote interoperability the and tasks we promote collaborative work using innovative department’s product range includes components for interactive multi-modal and multi-media interaction technologies. With image analysis, ontology-based specialist databases, network- ontology-based information systems, web services and intel- enabled information management systems, and training and ligent software agents the knowledge needed is distributed education systems. Compliance with and monitoring of national on time to the right people through suitable connections to and international software quality standards is an integral part personalized end-user devices in a layer-compliant granularity. of the development activities. Modern, technology-based learning environments and the use of “serious games” provide users with the required Our partners and clients include the German Federal Ministry decision-making abilities. Providers of knowledge-intensive of Defense (FMOD), Federal Office for equipment, information services will be supported in focusing on their core compe- technology and use of the Armed Forces (BAAINBw), tencies and creativity. the defense industry and the European Union. In various international cooperations experience in the field of image- based reconnaissance and surveillance is exchanged. In our research we cooperate with universities, colleges and partner institutions. Applications are mainly in the fields of defense and civil security.
110 Core Competence Image Exploitation Head of department: Dr.-Ing. Rainer Schönbein Phone +49 721 6091-248 [email protected]
www.iosb.fraunhofer.de/IAS
1 Interoperability.
Projects and products Equipment
• Image database – archiving system for the management • ISVA demonstrator – a hub for national and international of aerial and satellite images secured networks in the field of econnaissancer and • Image data management system for aerial and satellite surveillance image analysis in the field of reconnaissance and surveillance • SaLVe – radar image database center: a multi-sensor image • SAR Tutor – web-based training tool for SAR image analysis data archive for remote sensing • Crayons© – web-based authoring and learning environment • AMFIS – reconnaissance and surveillance with miniature • ViSAR – simulator for visualizing geometric radar effects aircrafts in the sensor network (configurable ground control • CSD/NSD Coalition/National Shared Database. Client-server stations, various UAVs, UGVs and sensors) system for distributing reconnaissance-relevant information • A mobile ad-hoc sensor network (GPS, imaging and acoustic, 1 (requests, orders, messages, sensor data and products) in vibration, temperature, motion and light sensors) accordance with STANAG 4559 • MAJIIC – demonstration laboratory (restricted area): Multi- • ISAAC (ISr Artifact Access Client) Software Suite (.lib, .bat, sensor Aerospace-Ground Joint ISR Interoperability Coalition desk, .map, .web) for accessing CSD/NSD servers according to • DNBL – development laboratory (restricted area): Distributed STANAG 4559 (NSILI – NATO Standard ISR Library Interface) Network Battlelab Laboratory for certification and testing • ISVA – intelligent reconnaissance sensor combination for of components for networked intelligence gathering and networking data, information, services and experts reconnaissance • I2Exrep – database-supported form-based report generation for analysis of aerial and satellite images according to STANAG 3377/3596 and other reporting formats • DbEd – Data Tree Editor for creation and maintenance of the 1 reporting vocabulary used in image based reconnaissance • MAJIIC 2 – Multi-INT All-source Joint ISR Interoperability Coalition • AMFIS ground control station – Generic ground control station. AMFIS (reconnaissance and surveillance with miniature aircraft in sensor networks) for controlling and coordinating stationary and mobile sensors/sensor carriers, and for evaluating sensor data and situation reports
Core Competence Image Exploitation 111 OBJECT RECOGNITION (OBJ)
Expertise and portfolio
The department Object Recognition (Objekterkennung - OBJ) tion. The field of Heterogeneous Hardware Structures develops and evaluates algorithms for automatic object deals with the specification and combination of hardware detection and object tracking in sensor networks. The structures suitable for complex real-time vision systems. department’s activities range from the evaluation of video streams in the infrared and visual spectral band and the Especially with regard to military tracking systems, performance analysis of laser sensor data to the semantic description of evaluation is an essential topic. Based on years of experience a three-dimensional, dynamic environment via multi-sensory the field Tracking and Tracker Assessment deals with the data acquisition and automatic alerting in case of specifically development and design of evaluation schemes that interrelate defined occurrences. In addition, real-time implementations and evaluate both the performance ability of tracking algo- of the algorithms are evaluated on the basis of heterogeneous rithms and the risk analysis, while possible counter-measures hardware structures. are taken into account.
The research work in the field of Object Recognition in Sen- The acquisition and analysis of 3D data is of increasing sor Networks is focused on the detection and representation importance in those application areas that require a high of objects in imagery data streams of interconnected mobile degree of automation and reliability of object recognition. sensors. In this context the technologies investigated include The department’s work in the field of Object Recognition aspect-independent descriptions of objects, the registration of in 3D Data is concerned with the development, optimization, sensor-generated images with three-dimensional context data, and evaluation of methods for 3D data analysis for use with and bandwidth-economical transfer of object information. established sensor techniques as well as prototypical hardware. In addition to object recognition, data acquired by theses sen- Video Content Analysis combines methods for the detection sors is used for detecting changes and for providing context and tracking of objects in video streams with algorithms for information for image exploitation. the conceptual description and analysis of the extracted quantitative information. The studies aim at devising systems Selected Projects for the semantic analysis of videos. This means that videos are not only analyzed quantitatively, but that the extracted • THS® - Target Handoff System information is associated with conceptual background know- • Semantic Video Analysis ledge in order to draw conclusions from the visually perceived • MODISSA – Mobile Distributed Situation Awareness environment. • Change Detection in Lidar sensor data • VibroTrack – distant vibration measurement on running Machine vision algorithms extend from simple filtering func- wind turbines tions up to complex analysis methods. Currently available hardware also varies with respect to computing performance, programming paradigms, architectures, and power consump-
112 Core Competence Image Exploitation Head of department: Dr. rer. nat. Michael Arens Phone +49 7243 992-147 [email protected]
www.iosb.fraunhofer.de/OBJ
1 Trajectory estimation of a 2 The project Semantic Video moving camera based solely on Analysis aims at detecting, clas- visual information. Top: camera sifying, and conceptually describ- view together with overlayed ing events and interrelations of visual features tracked in 3D events in visually perceivable during the process. Bottom: scenarios. birds eye view on the estimated trajectory of the camera (blue), the ground truth path (red), and 3D features of the surrounding (green).
1
2
Core Competence Image Exploitation 113 SCENE ANALYSIS (SZA)
Competencies and portfolio exploitation of data from a multi-sensor platform (VIS, LWIR, Hyperspectral and LIDAR) is one of the key features of actual Background of the department’s research activities is the demonstrators or future operational systems. Data fusion demand of intelligence and reconnaissance for the prompt and information extraction are the core competencies for a availability of interpretation results with georeference. This successful exploitation and are therefore one of the depart- includes both wide-ranging evaluation (screening) and local ment’s main research activities. 3D scene reconstruction, required as a basis for decision making in the context of military operations and disaster management. Often a scene can be evaluated properly only if its spatial A multitude of powerful airborne and spaceborne systems, extent can be determined. Therefore, the Scene Analysis e.g., Heron, SAR-Lupe and TerraSAR-X, delivers data that can department develops procedures for the automatic derivation no longer be evaluated by humans due to its sheer volume of 3D descriptions of urban terrain based on the evaluation and the resulting work load. Automatic conditioning and of multi-sensory image data acquired by spaceborne, airborne, processing of the data draws the interpreters attention to or land-based reconnaissance systems. relevant sections, thereby also enabling the efficient process- ing of large data volumes. For a fast and precise evaluation, To utilize the efficiency of networked sensor systems, the the interpreter needs assistance systems that are able to detect, method of interconnected sensor data evaluation must be analyze and classify objects and scene changes. designed based on the “system of systems” concept. For this purpose, procedures are being developed which relate The Scene Analysis department develops and studies methods the data of imaging sensors to a common reference frame. for the automatic evaluation of multi-sensor image data in The potential applications from the fusion of sensor data up reconnaissance networks. For this purpose efficient procedures to a real-time-generated overview of situations are being are being developed for segmentation, classification, scene analyzed and adequate procedures realized. reconstruction, change detection, and fusion of a wide range of sensor data. The research focuses on Only few sensors can acquire evaluable image data, irrespec- • Image interpretation tively of the daytime or current weather conditions. The per- • 3D object analysis formance of imaging radar systems, with a synthetic aperture • Cooperative data evaluation in sensor systems (SAR) is hardly limited in this regard. Because of their phase- • Exploitation of Synthetic Aperture Radar (SAR) images preserving evaluation, interferometric SAR systems are able to capture the 3D shape of a scene. Furthermore, by using time In the scope of image interpretation the analysis of hyper- series, very small surface movements can be detected. SAR spectral data is of particular importance. Here, methods for images are difficult to interpret by a human due to the specific the extraction of relevant information take center stage. mapping characteristics. Therefore, interpretation support is Applications range from the pure reduction of data for particularly valuable. SAR image analysis and simulation are a better utilization of transmission bandwidths to the therefore among the core competencies of the department, generation of indications in both single and multiple images with a special focus on feature analysis, change detection and (change detection and change categorization). The common change categorization in SAR images.
114 Core Competence Image Exploitation Head of department: Dr.-Ing. Karsten Schulz Phone +49 7243 992-106 [email protected]
www.iosb.fraunhofer.de/SZA
1 Road extraction from aerial images with a segment based random forest classification Research work focuses on the following core topics: using feature selection. 2 View on an automatically Image interpretation extracted model of the scene • Efficient screening procedures for the analysis of large “Vaihingen“ with buildings, data volumes vegetation and terrain. • Structural change detection • Analysis of hyperspectral image data • Fusion and exploitation of data from multi-sensor systems 1
3D object analysis • reconstruction of 3D objects from image sequences or laser scanner data • Automatic derivation of 3D building models from 3D point clouds
Cooperative data evaluation for networked sensor systems • Information fusion of sensor data and geo-information • Automatic georeferencing of image contents • Preparation of sensor data showing urban terrain for simulation systems
SAR image exploitation • Feature extraction and analysis, change detection and 12 categorization • Simulation of SAR image signatures for interpretation assis- tance (CohRaSS: Coherent Raytracing-based SAR Simulator) • Determination of ground heaving or depression by means of time series • Model-based building reconstruction from interferometric SAR images
Core Competence Image Exploitation 115 VIDEO EXPLOITATION SYSTEMS (VID)
Competences and portfolio
The department Video Exploitation Systems (VID) researches The main sensors taken into account are visual-optical, and develops video exploitation algorithms and systems for infrared, and in some cases also others (SAR, SWIR, UV, …) airborne, land-based and maritime sensors-systems. One core competence is the development of video exploitation A major aspect of our work is the realization of components systems incorporating geospatial data for unmanned aerial (commonly in form of binary libraries) to be integrated into vehicles (UAVs)/drones and surveillance cameras. Our systems larger systems. We also realize and deploy whole (software) improve situational awareness, which play a vital part in systems based on our state of the art software production the fields of disaster management, forensics, video security system. Further areas of expertise of the department include systems, homeland security, and defense against terrorism. interoperability in heterogeneous networks and application of The complexity and demands for robustness, reliability, and domain knowledge. The performance profile of the developed efficiency of the computed results are steadily increasing. software is measured by benchmarking and with test systems. Exploitation of airborne imagery from UAVs/drones is our The department VID is active in the fields of automatic pro- main activity. Further activities include the development of cessing and exploitation of image signals in complex, mainly components for moving sensor platforms, C-UAS (Counter non-cooperative surroundings. The image data comes mainly Unmanned Aerial Systems), video security applications and from image acquisition sensors in multi-modal platforms marine image exploitation. (space, air, land, or water). VID develops and integrates soft- ware for image processing, object classification, and fusion. Tasks and projects Therefore, we do research on state of the art computer • ABUL – Video exploitation system for aerial, land, vision algorithms optimized for specific scenarios, including or maritime based platforms: aspects like neural networks (deep learning), GPU-/multi-core --LUNA (German Bundeswehr, EMT) processing for high performance and embedded systems. --LUNA NG (Next Generation) The main research areas comprise: --ADS-95 RANGER (armasuisse) --IMINT Training Center: Full Motion Video training • Machine learning (German Bundeswehr, AZAALw) (esp. deep learning, convolutional neural networks) --Video exploitation (NATO, Airbus) • Super resolution --SuViMar Maritime video exploitation (WTD 71) • Change detection --ABUL for avionics-systems – Video functions for pilots in • Image optimization the cockpit • Multiple target detection, tracking, and classification • VABUL – Video Database ABUL – Database for change • Trajectory / track classification detection, surveillance, and reconnaissance purposes • Behavior analysis • MODEAS – Modulares Drohnen Erfassungs- und Assistenz • Geo-registration / mapping System / C-UAV System • High performance computing. --Parts of the detection algorithm in visual-optical image streams
116 Core Competence Image Exploitation Head of department: Dr.-Ing. Markus Müller Phone +49 721 6091-250 [email protected]
www.iosb.fraunhofer.de/VID
1 Software system ABUL for UAV (unmanned aerial vehicles) based reconnaissance and sur- veillance. 2 Software system ivisX for fo- --Tracking of detection hypothesizes rensic investigations. --Classification of tracks --Classification of drone signatures • NEST – CrowdControl – Video-based crowd density estimation for security / large events • ivisX – An Integrated Video Investigation Suite for Forensic Applications • Federal Ministry of Education and Research (BMBF) --MUSKAT – Multisensoriell gestützte Erfassung von Straf- tätern in Menschenmengen bei komplexen Einsatzlagen --S²UCRE – Sicherheit in städtischen Umgebungen: Crowd- Monitoring, Prädiktion und Entscheidungsunterstützung --FLORIDA: Flexibles, teilautomatisiertes Analysesystem zur Auswertung von Videomassendaten • European Union (EU) --MobilePass – Algorithms for touchless fingerprint and face verification with mobile devices for border control --Tulipp – Towards Ubiquitous Low-power Image Processing Platforms 1 --VICTORIA – Video analysis for Investigation of Criminal and TerrORIst Activities • DetAktiv – Detection and tracking of moving objects in UAV video data
2
Core Competence Image Exploitation 117 VARIABLE IMAGE ACQUISITION AND PROCESSING (VBV) RESEARCH GROUP
Competencies and Research Topics
The Variable Image Acquisition and Processing (VBV) Research for novel applications where traditional methods would fail or Group develops methods and systems for automated visual not be flexible enough. inspection that are based on variable image acquisition tech- niques, or, more generally, exploit various kinds of heteroge- Projects neous information. Multiple theoretical and application-related issues studied here in close cooperation with the other • Ellipsometric inspection of thin films on curved surfaces departments of the IOSB and the Vision and Fusion Laboratory • Visual inspection of transparent objects (Lehrstuhl für Interaktive Echtzeitsysteme – IES) of the Karlsruhe • Automated detection of anomalies in industrial production Institute of Technology (KIT) include: • Holistic planning and optimisation of industrial optical • Holistic systems theory-based modeling of image measurements acquisition and optimization of the evaluation process • Automated detection of anomalies in industrial production • Reproducible acquisition of optimal image series, for processes example by variation of illumination, focusing, camera • Classification of moving objects in aerial surveillance data position and optical filters • Automated interactive assistance and anomaly detection in • Fusion of data from the image series and from the other surgical treatment available information sources • Development of advanced optical 3D measurement • Online control of the variable acquisition parameters systems (Active Vision) • Open adaptive modeling of the environment for artificial • Inspection and reconstruction of partially or fully specular cognitive systems surfaces • Probabilistic planning methods for deflectometric surface inspection The variability of image acquisition is crucial if a single image • Interactive techniques for augmented reality environments does not fully capture the features of interest of a studied • Detection of surface defects based on deflectometric object or scene. The control system may then take multiple measurement data images, adjusting the parameters – such as the camera’s posi- • Person identification and face recognition in video data tion or field of view (for example to improve visibility of the • Control of cyber-physical production systems occluded objects) – or switching to different spectral bands. In • Methods of face registration, 3D reconstruction, and combination with data fusion, this may provide a description super-resolution in video data quality that is hardly if at all achievable with other inspection • Methods of classification in hyper-spectral inspection methods. Facilitated by the availability of inexpensive camera • Planning and execution of maneuvers for autonomous and manipulation systems and by the progress in modeling vehicles in traffic and planning algorithms, this kind of approach paves the way • Methods for specular 3D reconstruction
118 Core Competence Image Exploitation Head of department: Dr.-Ing. Miro Taphanel Phone +49 721 6091-389 [email protected]
www.iosb.fraunhofer.de/VBV
1 Laboratory setup for infra- red-deflectometry. 2 Deflectometric inspection in Robot / MiniCAVE laboratory.
Infrastructure and equipment
Robot laboratory: The laboratory’s industrial robot provides precise, automated, and reproducible adjustment of the image acquisition geometry. For example: illumination re-positioning allows very complex objects to be captured with a high degree of accuracy. In addition to traditional camera-based inspection, 1 the laboratory is used for the inspection of specular objects with a deflectometric sensor head.
Infrared deflectometric laboratory: Certain diffuse surfaces (such as metal sheets used in auto bodies) are specular when observed in the thermal infrared spectrum allowing their accurate inspection for the presence of dents, waves, and irregularities using deflectometry. However, unlike thermal infrared cameras, long-wavelength imaging devices are not readily available. The laboratory hosts several prototypes of devices to generate fast thermal deflectometric pattern series. In particular, one prototype utilizes a powerful laser to “draw” a pattern on a moving plastic band. 2 MiniCAVE laboratory: Typically, the smaller the pattern projection screen, the longer a deflectometric inspection of a complex object takes. The radical way to increase the inspection area processed with a fixed camera-screen constellation is to completely enclose the object in a shell that serves as a screen. The MiniCAVE labo- ratory is equipped with digital projectors that enable a nearly complete coverage of the environment with encoding patterns (displayed on the walls and the ceiling). The research here is focused on calibration and measurement techniques in such environments and the associated advantages and challenges for the inspection tasks.
Core Competence Image Exploitation 119 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE ADVISORY BOARD KURATORIUM
FRAUNHOFER INSTITUTE OF OPTRONICS, SYSTEM TECHNOLOGIES AND IMAGE EXPLOITATION
Prof. Dr.-Ing. Frank Artinger Dr. Fritz Merkle Hochschule Karlsruhe, Technik und Wirtschaft, Karlsruhe (Vorsitzender) OHB-System AG, Bremen
Dipl.-Ing. Roland Bent Dr.-Ing. Horst Nasko Phoenix Contact GmbH & Co. KG, Blomberg Technologiemanagement, München
Dr. Jürgen Bestle Dr.-Ing. Jörn Oprzynski Hensoldt Sensors GmbH, Taufkirchen Siemens AG, Karlsruhe
Prof. Dr.-Ing. Barbara Deml Dipl.-Geogr. Marion Sielemann Karlsruher Institut für Technologie KIT, Karlsruhe Bundesministerium der Verteidigung, Bonn
Prof. Dr. Cornelia Denz Dr. Thomas Steckenreiter Westfälische Wilhelms-Universität, Münster Samson AG, Frankfurt a. M.
Prof. Dr.-Ing. Rüdiger Dillmann Prof. Dr.-Ing. Christoph Stiller Karlsruher Institut für Technologie KIT, Karlsruhe Karlsruher Institut für Technologie KIT, Karlsruhe
Dr. Gerhard Elsbacher Dr.-Ing. Frank Weber MBDA Deutschland GmbH, Schrobenhausen Ministerialrat Dipl.-Ing. Norbert Michael Weber Dr. Jan-Henning Fabian Bundesministerium der Verteidigung, Bonn ABB AG, Ladenburg Oberst Peter Webert Dipl.-Ing. Robert Fetter Bundesministerium der Verteidigung, Berlin Thüringer Ministerium für Wirtschaft, Wissenschaft und Digitale Gesellschaft, Erfurt
Prof. Dr.-Ing. Christian Heipke Leibniz Universität Hannover, Hannover WE MOURN Thomas Kühn Airbus Defence and Space GmbH, Taufkirchen WIR TRAUERN
Dr. Jörg Kushauer Our advisory board member Dr. Sven Olaf, Airbus Defence Diehl BGT Defence GmbH & Co. KG, Überlingen and Space GmbH, of Immenstaad am Bodensee, sadly passed away on January 10th, 2018. We will honor his Dr. Christian Martens memory. Rheinmetall Electronics GmbH, Bremen
121 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
SCIENTIFIC CONSULTANTS WISSENSCHAFTLICHE BERATER
Prof. Dr. Sebastian Abeck Prof. Dr.-Ing. habil. Pu Li Karlsruher Institut für Technologie (KIT), Karlsruhe Technische Universität Ilmenau, Ilmenau
Prof. Dr. Michael Beigl Prof. Dr. Oskar von der Lühe Karlsruher Institut für Technologie (KIT), Karlsruhe Leibniz Gemeinschaft, Berlin
Prof. Dr. Georg Bretthauer Prof. Dr. Alexander Pretschner Karlsruher Institut für Technologie (KIT), Karlsruhe Technische Universität München, München
Prof. Dr.-Ing. Carsten Dachsbacher Prof. Dr.-Ing. Fernando Puente León Karlsruher Institut für Technologie (KIT), Karlsruhe Karlsruher Institut für Technologie (KIT), Karlsruhe
Prof. Dr.-Ing Uwe Hanebeck Prof. Dr.-Ing. Tanja Schultz Karlsruher Institut für Technologie (KIT), Karlsruhe Universität Bremen, Bremen
Prof. Dr.-Ing. Björn Hein Prof. Dr.-Ing. Uwe Sörgel Karlsruher Institut für Technologie (KIT), Karlsruhe Universität Stuttgart, Stuttgart
Prof. Dr. Rüdiger Heintz Prof. Dr.-Ing. Rainer Stiefelhagen DHBW Mannheim, Mannheim Karlsruher Institut für Technologie (KIT), Karlsruhe
Prof. Dr. Stefan Heiss Prof. Dr.-Ing. Stefan Streif Hochschule Ostwestfalen-Lippe, Lemgo Technische Universität Chemnitz, Chemnitz
Prof. Dr.-Ing. Michael Heizmann Ulrich Thönnessen Karlsruher Institut für Technologie (KIT), Karlsruhe Wolfgang Wittenstein Prof. Dr.-Ing. Stefan Hinz Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Dirk Westermann Technische Universität Ilmenau, Ilmenau Prof. Dr. med. Wolfgang Hoffmann Universität Greifswald, Greifswald
Prof. Dr. Wolfgang Karl Karlsruher Institut für Technologie (KIT), Karlsruhe
Prof. Dr.-Ing. Kristian Kroschel Karlsruher Institut für Technologie (KIT), Karlsruhe
122 WORKING GROUPS MITARBEIT IN ARBEITSKREISEN
Big Data Optimierung Ljiljana Stojanovic (Leitung), Liane Rublack (Leitung), Mathias Anneken, Yvonne Fischer, Erik Krempel, Alexander Arnoldt, Therese Klarner, Steffen Nicolai Alexander Pretschner, Sebastian Robert, Tobias Schuchert, Arne Schumann, Thomas Usländer, Oliver Warweg Prognose Stefan Klaiber (Leitung), Counter-Improvised Explosive Device Alexander Arnoldt, Peter Bretschneider Ilja Kaufmann (Leitung), Jan Bartelsen, Stefan Brüstle, Yvonne Fischer, Jürgen Geisler, Regelungstechnik Wolfgang Groß, Klaus Jäger, Alexander Schwarz, Karin Stein, Benjamin Fischer (Leitung), Sebastian Flemming, Stefan Klaiber, Steffen Nicolai Gesetz zur Digitalisierung der Energiewende Ralf Marquardt (Leitung), Standardisierte IT-Sicherheit Matty Al Doyaili, Jens Hörnlein, Björn Illing, Ronny Kreißl, Silvija Höger (Leitung), Sven Möller, Dennis Rösch, Tobias Schunk, Andreas Vogel, Peter Bretschneider, Barbara Essendorfer, Benjamin Fischer, Oliver Warweg Christian Haas, Birger Krägelin, Philipp Klotz, Erik Krempel, Oliver Niggemann, Bastian Schaller, Rainer Schönbein Mensch-Roboter-Interaktion Christian Frese (Leitung), Unterwassersensorik Sergej Bergen, Patrick Dunau, Yvonne Fischer, Christian Frese, Philipp Woock (Leitung), Christian Frey, Björn Hein, Sascha Heymann, Björn Kroll, Jan Bartelsen, Katrin Braesicke, Gunnar Brink, Patrick Dunau, Christian Lengenfelder, Janko Petereit, Sebastian Robert, Christian Frey, Horst Hammer, Marco Jacobi, Silvia Kuny, Rainer Stiefelhagen, Michael Voit Helge Renkewitz, Kevin Roesch, Torsten Pfützenreuter, Karsten Schulz, Detlev Sprung, Multispektrale Datenerfassung und Auswertung Thomas Längle (Leitung), Mohammad Abdo, Sebastian Bauer, Jürgen Beyerer, APPEALS Mirko Bunzel, Fernando Chaves-Salamanca, Carsten Dachsbacher, Wolfgang Groß, Robin Gruna, BERUFUNGEN Michael Heizmann, Wolfgang Krippner, Christian Negara, Fernando Puente León, Henning Schulte, Uwe Sörgel, Berufung auf die W3-Professur »Mechatronische Günter Struck, Max Winkelmann Messsysteme« von Dr. Michael Heizmann am Institut für Industrielle Informationstechnik (IIIT), Karlsruher Institut für Oberflächeninspektion Technologie (KIT) zum 1.4.2016 Michael Heizmann (Leitung), Jan Burke, Sebastian Höfer, Ilja Kaufmann, Thomas Längle, Ernennung zum Professor für »Energieeinsatzoptimierung« Mahsa Mohammadikaji, Thomas Müller, Christian Negara, von Dr.-Ing. Peter Bretschneider an der Technischen Henning Schulte, Miro Taphanel Universität Ilmenau zum 1.11.2016
123 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
HONORS AND AWARDS EHRUNGEN UND PREISE
Jennifer Sander und ihrem Team Barbara Essendorfer, Dr. Thomas Usländer und Prof. Thomas Rauschenbach Norbert Heinze, Dr. Wolfgang Krüger und Michael Teutsch erhielten den Veröffentlichungspreis (Publikationspreis 2016) wurde der IOSB Wirtschaftsinnovationspreis 2015 verliehen in der Kategorie »Veröffentlichungen« für »operationelle Anpassung Stream Computing« Reinhard Herzog hat zusammen mit weiteren Autoren des Prof. Hartwig Steusloff wurde vom DIN mit der Papers »Towards a New NATO Cerfitication Capability for Beuth-Denkmünze ausgezeichnet. Diese hohe Auszeichnung HLA Interoperability« den SISO Award 2016 erhalten des DIN erhielt er für sein besonderes Engagement im Sinne der Deutschen Normungsstrategie die Unterstützung von Dr. Torsten Pfützenreuter mit Team Ganzorig Baatar, Innovation und Technikkonvergenz durch Normung und Sebastian Matz, Prof. Thomas Rauschenbach, Helge Renkewitz, Standardisierung voranzutreiben Daniel Weber wurde der IOSB Wirtschaftsinnovationspreis 2016 verliehen für das Projekt »Entwicklung eines ferngesteuerten Dr. Reinhard Ebert wurde vom Vorstand der Fraunhofer- Unterwasserfahrzeugs für die Überwachung der Wasserqualität« Gesellschaft für seine langjährigen Verdienste für das IOSB und seine Vorgängerinstitute, sein großes Engagement bei Dr. Dirk Feldmann und Melanie Pohl haben auf der der Gründung des IOSB und besonders für seine Tätigkeit International Conference on Computer Graphics Theory and für unser Institut über den nominellen Beginn seines Ruhe- Applications (GRAPP 2016) den Best Paper Award erhalten standes hinaus mit dem Fraunhofer-Taler ausgezeichnet für: »Generating Straight Outlines of 2D Point Sets and Holes using Dominant Directions or Orthogonal Projections«, Dr. Wilmuth Müller und Frank Reinert wurden für ihren erhalten, Italien, Rome, 27.-29.2.2016 Entwurf der Unternehmens- und Systemarchitektur im EU-Projekt SALUS (Security And Interoperability in Next Stefan Becker, Hilke Kieritz, Dr. Wolfgang Hübner und Generation PPDR Communication Infrastructures) mit dem Dr. Michael Arens haben auf der International Conference International Critical Communications Award on Image and Signal Processing (ICISP) 2016 den Best Paper »Best Evolution to Future Broadband« ausgezeichnet Award erhalten für: »On the benefit of state separation for tracking in image space with an interacting multiple model Andreas Zepp wurde von der Firma Qioptiq für seinen filter« erhalten, Kanada, Trois-Rivières, 30.5.-1.6.2016 Produktvorschlag bei dem Wettbewerb »Are you the Photonic Brain« mit dem 1. Platz prämiert Sergius Dyck, Daniel Haferkorn und Jennifer Sander haben auf der World Multi-Conference on Systemics, Cybernetics Johannes Mulder wurde gemeinsam mit der NATO-Arbeits- and Informatics (WMSCI 2016) den Best Paper Award für gruppe MSG 106 (SPHINX) mit dem Scientific Achievement »An Organizational-Technical Concept to Deal with Open Award ausgezeichnet Source Software License Terms« erhalten, USA, Orlando, Florida, 5.-8.7.2016 Reinhard Herzog wurde gemeinsam mit der NATO-Arbeits- gruppe MSG 106 (SPHINX) mit dem Scientific Achievement Matthias Richter, Georg Maier, Dr. Robin Gruna, Award ausgezeichnet Prof. Thomas Längle und Prof. Jürgen Beyerer haben auf dem 2nd World Congress on Electrical Engineering and Computer Dr. Jochen Meidow und Dr. Eckart Michaelsen erhielten Systems and Science (EECSS’16) für ihr Paper »Feature den Journalpreis (Publikationspreis 2016) in der Kategorie Selection with a Budget«, den Best Paper Award für ihr »Artikel in wissenschaftlichen Zeitungen« Paper »Feature Selection with a Budget«, erhalten, Ungarn, Budapest, 16.-17.8.2016 Ph.D. Szymon Gladysz und Dr. Dimitri Bulatov erhielten den Konferenzpreis (Publikationspreis 2016) in der Kategorie Andreas Bunte, Alexander Dietrich und Prof. Oliver Niggemann »Artikel in Tagungsbändern« haben auf der International Conference on Emerging Technologies and Factory Automation (ETFA 2016) den Best Paper Award für: »Integrating Semantics for Diagnosis of Manufacturing System«, erhalten, Berlin, 6.-9.9.2016
124 Daniel Wegner und Endre Repasi haben auf der SPIE Security Georg Maier, Florian Pfaff, Carsten Pieper, Dr. Robin Gruna, and Defense den Best Paper Award für »Image based Benjamin Noack, Harald Kruggel-Emden, Prof. Thomas Längle, performance analysis of thermal images« erhalten, Berlin, Prof. Uwe D. Hanebeck, Siegmar Wirtz, Viktor Scherer und 10.-13.9.2016 Prof. Jürgen Beyerer haben auf der »3rd Conference on Optical Characterization of Materials (OCM 2017)« den Best Paper Johannes Meyer hat auf der »2nd International Conference Award für ihr Paper »Improving material characterization in on Frontiers of Signal Processing« (ICFSP 2016) den Best sensor-based sorting by utilizing motion information«, erhalten, Presentation Award für seinen Vortrag »Aquiring and Karlsruhe, 22.-23.3.2017 Processing Light Deflection Maps for Transparent Object Inspection«, erhalten, Polen, Warschau, 15.-17.10.2016 Dr. Thomas Usländer hat auf der Hannover Messe den DIN Innovationspreis DIN SPEC 16593 für »RM-SA – Referenz- Dr. Stefan Windmann, Jens Eickmeyer und modell für Industrie 4.0 Servicearchitekturen – Grundkonzepte Prof. Oliver Niggemann haben anlässlich der Eröffnung der einer interaktionsbasierten Architektur« erhalten, Hannover, Automation 2017 den atp Award in der Kategorie Industrie 25.4.2017 für »Fehler in Prozessen zuverlässig erkennen. Bewertung der Wahrscheinlichkeit fehlerhafter Messwerte« erhalten Arne Neumann, Marco Ehrlich, Lukasz Wisbniewski und Prof. Jürgen Jasperneite haben auf der 13th IEEE International Work- Dr. Bernd Eberle, Melanie Pohl, Dr. Gunnar Ritt, Michael Körber shop on Factory Communication Systems (WFCS 2017) den und Dr. Reinhard Ebert sind verantwortlich für den Erhalt Best Paper Award für: »Towards monitoring of hybrid industrial des SET Panel Excellence Awards der 19-köpfigen internatio- networks« erhalten, Norwegen, Trondheim, 31.5.-2.6.2017 nalen Wissenschaftlergruppe NATO Gruppe SET-198 für Ihre Arbeiten zu »Visible Laser Dazzle-Effects and Protection« Arne Schumann, Lars Sommer, Johannes Klatte, Dr. Tobias Schuchert und Prof. Jürgen Beyerer haben auf dem Alwin Dimmeler erhielt für seinen Beitrag zur SET-190 Task AVSS-Workshop (International Workshop on Small-Drone Group on Phenomenology and Exploitation of Thermal Hyper- Surveillance, Detection and Counteraction Techniques), den spectral Sensing den »2017 Scientific Achievement Award« Best Paper Award für ihr Paper »Deep Cross-Domain Flying der NATO Science and Technology Organization Object Classification for Robust UAV Detection« erhalten, Italien, Lecce, 28.8.2017 Henning Schulte mit Team Alexander Enderle, Jürgen Hock, Bettina Otten und Petra Riegel erhielten für das Projekt Pascal Kiefer hat auf der SPIE Security and Defense in der »Mockup - Mobiler Sensor zur Messung von Frische und Konferenz »Target and Background Signatures« den Best Echtheit hochwertiger Produkte« den Wirtschaftsinnovations- Student Paper Award für: »Angular dependence of spectral preis reflection for different materials« erhalten, Polen, Warschau, 11.-14.9.2017 Merlin Becker, Dr. Wolfgang Middelmann und Andreas Lenz erhielten für das Projekt »Future Combat Air System« den Daniel Manger und Dr. Dieter Willersinn haben auf der »7th Wirtschaftsinnovationspreis International Conference on Image Processing Theory, Tools and Applications« (IPTA 2017) den Best Paper Award / 1st Prof. Thomas Rauschenbach, Dr. Torsten Pfützenreuter, runner up für: »Enlarging the Discriminability of Bag-of-Words Sebastian Matz, Daniel Weber, Ganzorig Baatar, Representations with Deep Convolutional Features« erhalten, Helge Renkewitz erhielten für das Projekt »Remotely Kanada, Montreal, 28.11.-1.12.2017 Operated Vehicle (ROV) für den Unterwassereinsatz« den Wirtschaftsinnovationspreis
125 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
SPECIAL EVENTS BESONDERE VERANSTALTUNGEN
4. VDI-Fachkonferenz »Big Data Technologien in der Produk- 2016 tion 2016« der VDI-Wissensforum GmbH, Leitung: Prof. M. Heizmann, Karlsruhe, 28.-29.6.2016, 70 Teilnehmer 29. Sitzung des Fachausschusses 8.12 (ehemals 3.51) »Bild- verarbeitung in der Mess- und Automatisierungstechnik« der Chinesische Delegation von Geschäftsführern zur Schulung VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Industry 4.0 am AST, Ausrichter: AST Ilmenau, 28.-29.7.2016, Frankfurt a. M., 22.1.2016, 12 Teilnehmer 10 Teilnehmer
Technologie-Stammtisch des Bundesverbandes mittelständischer 7. Wissenschaftscampus der Fraunhofer-Gesellschaft, Wirtschaft, Ausrichter: AST Ilmenau, 8.2.2016, 25 Teilnehmer Ausrichter: AST Ilmenau, 15.-16.8.2016, 34 Teilnehmer
3. Counter-IED Workshop, Fraunhofer IOSB, Organisation: Dr. Doktorandenseminar, Ausrichter: AST Ilmenau, 7.9.2016, Ilja Kaufmann, Ettlingen, 16.-17.2.2016, 30 Teilnehmer 9 Teilnehmer
50. Regelungstechnisches Kolloquium, Organisatorische 1st European Machine Vision Forum, Mitglied im Scientific Leitung: Prof. M. Heizmann, Boppard, 17.-19.2.2016, 30 Advisory Board: Prof. M. Heizmann, Heidelberg, 8.-9.9.2016, Beiträge, 208 Teilnehmer 130 Teilnehmer
Programmausschuss und Tagungsleitung des VDI/VDE-GMA- Lehrveranstaltung: Industrie 4.0: Was steckt hinter der »vierten Expertenforum »Modellbildung«, Organisation und Mitarbeit: industriellen Revolution? Einführung: Trendbegriff "Industrie Prof. M. Heizmann, Karlsruhe, 2.-3.3.2016, 31 Teilnehmer 4.0"«- begriffliche Klärung und Vielfalt des Begriffs, Leitung: Dr. M. Schleipen, Bonner Akademie für Forschung und Lehre 1.Counter-UAS Kolloquium »Kleine UAV’s-Gefahren und praktischer Politik, Bonn, 14.9.2016, 50 Teilnehmer Gegenmaßnahmen«, am IOSB, Karlsruhe, 16.3.2016, 90 Teilnehmer »2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016)«, Associate Sitzung des EMS-EDM Produktbeirates, Ausrichter: AST Editor und Mitglied im Award-Komitee: Prof. M. Heizmann, Ilmenau, Merseburg, 13.4.2016, 11 Teilnehmer Baden-Baden, 19.-21.9.2016
30. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in 31. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M. Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 25.4.2016, 10 Teilnehmer 23.9.2016, 12 Teilnehmer
Girls’Day 2016, »Licht, Lärm und Krabbelei«, AST Ilmenau, VDMA-Veranstaltung: »Maschinen und Anlagen-bereit für 28.4.2016, 6 Teilnehmer Industrie 4.0« Abschlussveranstaltung der Projekte CSC, piCASSO, eApps4Production, itsowl-IV, SecurePLUGandWORK, Besuch des CNN anlässlich DeDAve, AST Ilmenau, 3.6.2016, 6 Frankfurt a. M., 23.9.2016, 70 Teilnehmer Teilnehmer 78. Sitzung des Fachausschusses 1.10 »Grundlagen Mess- Energiewirtschaftstour 2016, Mitglieder des Thüringer Land- systeme« der VDI/VDE-GMA, Organisation und Leitung: tags besuchen das AST, Ilmenau, 9.6.2016, 8 Teilnehmer Prof. M. Heizmann, Frankfurt a. M., 26.9.2016, 12 Teilnehmer EMS-EDM PROPHET® Anwenderkonferenz, Ausrichter: AST Ilmenau, Heilbad Heiligenstadt, 14.-15.6.2016, 51 Teilnehmer Fachkongress Industrial Analytics & Big Data in der Automobil- industrie, Leitung des Themenblocks »Industrial Dataspace Use TRM-Workshop, Fraunhofer IOSB, Organisation: J. Mündel, Cases« und Vortrag »Datenanalyse und IT-Sicherheit im Smart Ettlingen, 28.-29.6.2016, 10 Teilnehmer Factory Web«: Dr. T. Usländer, Berlin, 28.9.2016, 80 Teilnehmer
126 Konferenz »Machine Learning for Cyber-Physical-Systems« Beiratsmitglieder: C. Frey, Prof. M. Heizmann, Dr. W. Hübner, 2017 Organisator: Dr. C. Kühnert, Karlsruhe, 29.9.2016, 25 Teilnehmer 8. NRW Symposium »Sicher in der digitalen Welt? Chancen Podiumsdiskussion Virtual Computing: Spielend Fertigen. für Unternehmen durch Schutz vor Cyberangriffen«, Forum IT & Business 2016, Stuttgart, 7.10.2016, 100 Teilnehmer »Sicherheitslabor für Industrie 4.0«, Leitung: Dr. C. Haas, Düsseldorf, 12.1.2017, 200 Teilnehmer 9. Fraunhofer Vision Technologietag 2016, Fraunhofer- Zentrale, München, 19.-20.10.2016 MAROS 2017–Maritime Robotik und Sensorik, Ausrichter: IOSB-AST Ilmenau, Gesellschaft für Maritime Technik, BMWI, Branchenworkshop IT–Sicherheit für Industrie 4.0, Präsentation Pro Tempre, Potsdam, 12.-13.1.2017, 80 Teilnehmer des Lernlabor Cybersicherheit–Sicherheit für die industrielle Produktion, Tag der Cybersicherheit, Fraunhofer-Forum Berlin, 32. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in Berlin, 20.10.2016, 30 Teilnehmer der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. Chinesische Delegation von Geschäftsführern zur Schulung M., 20.1.2017, 18 Teilnehmer Industry 4.0 am AST, Ausrichter: AST Ilmenau, 27.10.2016, 30 Teilnehmer 79. Sitzung des Fachausschusses 1.10 »Grundlagen Mess- systeme« der VDI/VDE-GMA, Organisation und Leitung: Seminar FA 1.07 »Daten- und Informationsfusion« der Prof. M. Heizmann, Frankfurt a. M., 10.2.2017, Carl-Cranz-Gesellschaft e. V., Organisation und Leitung: 19 Teilnehmer Prof. M. Heizmann, Karlsruhe, 7.-10.11.2016, 8 Teilnehmer Sitzung des EMS-EDM Produktbeirates, Ausrichter: AST Panel discussion: »Preparing your architecture for serving IoT Ilmenau, Evangelisches Augustinerkloster, Erfurt, 14.2.2017, technologies: Addressing platforms, connectivity and security 11 Teilnehmer challenges« IoT World Europe, Irland, Dublin, 21.11.2016, 80 Teilnehmer 51. Regelungstechnisches Kolloquium, Organisatorische Leitung: Prof. M. Heizmann, Boppard, 15.-17.2.2017, Seminar FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« 30 Beiträge, 199 Teilnehmer der Carl-Cranz Gesellschaft e.V., Karlsruhe, 22.-23.11.2016, 29 Teilnehmer Poster presentation: »Network and Topology Models to Support IDS Event Processing«, 3rd International Conference Fraunhofer VISION-Seminar mit Praktikum »Inspektion und on Information Systems Security and Privacy ICISSP, Portugal, Charakterisierung von Oberflächen«, Fraunhofer IOSB, Porto, 18.-22.2.2017 Karlsruhe, 7.-8.12.2016 Research and Strategic Meeting: ONERA/DOTA and »IT-Sicherheit in der Produktion«, Kooperationsveranstaltung Fraunhofer IOSB on Optronics and Optics, Frankreich, Paris, mit der Innovationsallianz der TechnologieRegion Karlsruhe, 7.3.2017, 5 Teilnehmer Leitung und Organisation: Dr. C. Haas, Dr. O. Sauer, Karlsruhe, 08.12.2016, 35 Teilnehmer 1. Industrial Vision Conference der Süddeutscher Verlag Veranstaltungen GmbH, Mitarbeit im Fachbeirat und Forum »Bildverarbeitung« veranstaltet durch das Fraunhofer Moderation: Prof. M. Heizmann, Ludwigsburg, 8.-9.3.2017, IOSB und das IIIT, Organisation, Mitarbeit im Program- 60 Teilnehmer mausschuss und Leitung: Prof. M. Heizmann, Karlsruhe, 1.-2.12.2016, 25 Beiträge, ca. 50 Teilnehmer Eröffnung des Lernlabors Cybersicherheit mit dem Demonstrator »IT Sicherheitslabor für Industrie 4.0«, Seminar Oberflächenmesstechnik, Fraunhofer-Allianz Vision, Lemgo, 16.3.2017 Karlsruhe, 7.-8.12.2016
127 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
SPECIAL EVENTS BESONDERE VERANSTALTUNGEN
Japanische Delegation und nrw.invest, Fraunhofer IOSB-INA, Berliner Energietage, Fachkonferenz »Digitalisierung der Lemgo, 18.3.2017, 30 Teilnehmer Energiewelt – Herausforderungen und Lösungsansätze«, Fraunhofer-Allianz Energie, Berlin, 5.5.2017 Special Session »Geospatial Aspects in Industry 4.0«, Techni- cal Committee Meeting, Open Geospatial Consortium (OGC), OpenFactoryDay – Tag der offenen Tür in der SmartFactoryOWL, Leitung: Dr. T. Usländer, Niederlande, Delft, 20-24.3.2017, Fraunhofer IOSB-INA, Lemgo, 13.5.2017, 600 Teilnehmer 100 Teilnehmer VDI Wissensforum Big Data in der Produktion, Ausrichter: OCM-SpectroNet Collaboration Conference 2017, VDI, Karlsruhe, 16.-17.5.2017, 50 Teilnehmer Fraunhofer IOSB, Karlsruhe, 21.3.2017, 65 Teilnehmer Seminar »Vorstellung der Arbeiten der Gruppe Optik 3rd International Conference on Optical Characterization of der Atmosphäre & Meteorologie / Signatorik«, Stumeta Materials (OCM 2017), Organisation, Leitung und Mitarbeit (Studentische Meteorologentagung 2017), Leitung: im Programmausschuss: Prof. T. Längle, Fraunhofer IOSB, Dr. K. Stein und Dr. D. Sprung, 25.5.2017, 16 Teilnehmer Karlsruhe, 22.-23.3.2017, 87 Teilnehmer China Engineering Cost Association (CECA) | Workshop, Panel Discussion: »IoT & Industry 4.0 Facilitating of Fraunhofer IOSB-INA, Lemgo, 19.6.2017, 16 Teilnehmer Manufacturing (How Sensors, connectors, and Big Data will impact your business)«, Global Smart Manufacturing 34th EDA CapTech EOST Meeting, Fraunhofer IOSB, Summit, Frankfurt a. M., 29.-31.3.17, 200 Teilnehmer Organisation: Dr. H. Bürsing, Ettlingen, 20.-21.6.2017, 30 Teilnehmer OSA Konferenz: »Quantum Information and Measurement (QIM)-IV: Quantum Technologies«, Université Pierre et Marie EDA ECOMOS Workshop, Fraunhofer IOSB, Organisation: Curie, Frankreich, Paris, 5.-7.4.2017 Dr. H. Bürsing, Ettlingen, 21.-22.6.2017, 30 Teilnehmer
Delegation Kompetenzzentrum Mittelstand Österreich, EMS-EDM PROPHET Anwendertage für Kunden von Fraunhofer IOSB-INA, Lemgo, 6.4.2017, 18 Teilnehmer EMS-EDM PROPHET®, Ausrichter AST Ilmenau, Jena, 21.-22.6.2017, 46 Teilnehmer Panel discussion: »Talk@3: Accelerating the Industrial Inter- net through Testbeds«, Hannover Messe Industrie, Hannover, 12th International ITBM&S Workshop (IR Target and Back- 24.-28.4.2017, 80 Teilnehmer ground, Modeling and Simulation), Fraunhofer IOSB und ONERA/DOTA, Organisation und Durchführung: E. Repasi Delegation Kaiyuan, China in der SmartFactoryOWL, und Dr. K. Braesicke, Ettlingen, 26.-29.6.2017, 25 Teilnehmer Fraunhofer IOSB-INA, Lemgo, 25.4.2017, 25 Teilnehmer AUTOMATION 2018, Ausrichter: VDI, Baden-Baden, Deutsch-Chinesische Allianz in der SmartFactoryOWL, 27.6.2017, 450 Teilnehmer Fraunhofer IOSB-INA, Lemgo, 26.4.2017, 20 Teilnehmer Delegation RTB, Korea, Fraunhofer IOSB-INA, Lemgo, Girls’Day 2017, Ausrichter: AST Ilmenau in Kooperation mit 12.7.2017, 30 Teilnehmer dem IDMT, Ilmenau, 27.4.2017, 15 Teilnehmer Abstimmungsgespräch »IR-Technologie für optronische 33. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in Sensoren (ATOS)«, Fraunhofer IOSB, Organisation: der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Dr. R. Ebert, J. Fartak, Ettlingen, 13.7.2017, 34 Teilnehmer Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 28.4.2017, 9 Teilnehmer Erfahrungsaustausch Industrial Security, Esslingen, 19.7.2017, 25 Teilnehmer
128 INTERNATIONAL GUESTS AND VISITING SCIENTISTS INTERNATIONALE GÄSTE UND GASTWISSENSCHAFTLER
2017 CLEO Pacific Rim Conference, The Optical Society (OSA), Singapur, 31.7.-4.8.2017
Chinesische Delegation, Fraunhofer IOSB-INA, Lemgo, 22.8.2017, 27 Teilnehmer
80. Sitzung des Fachausschusses 1.10 »Grundlagen Messsys- teme« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Berlin, 28.9.2017, 14 Teilnehmer
34. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 6.10.2017, 10 Teilnehmer it’s OWL Transfertage 2017, Ausrichter: it’s OWL, Lemgo, 10.-11.10.2017, 250 Teilnehmer
Fachtagung Cybersicherheit, Fraunhofer IOSB-INA, ARROW, Lemgo, 18.10.2017, 55 Teilnehmer
Industrie 4.0–Kompakt, Fraunhofer IOSB-INA, Lemgo, 19.10.2017, 20 Teilnehmer Qiucheng Li, China, PhD-Student, China Agriculture ML4CPS–Machine Learning for Cyber Physical Systems and University, 1.9.2012-31.12.2017 Industry 4.0, Fraunhofer IOSB-INA und SV-Veranstaltungen, Lemgo, 25.-26.10.2017, 75 Teilnehmer Duc Long Nguyen, DAAD-Stipendium, Vietnam, 1.10.2013-31.10.2017 10. Technologietag 2017 und Jubiläumskongress 20 Jahre Fraunhofer Vision, Fraunhofer-Entwicklungszentrum Röntgen- Prof. Lex van Eijk, TNO Den Haag, Universität Nantes/ technik EZRT, Fürth, 25.-26.10.2017 Frankreich, seit 6.10.2014
Tagung »Prüfprozesse in der industriellen Praxis« der VDI- Dewei Li, Engineer, National Deep Sea Center, China, Wissensforum GmbH, Mitarbeit im Programmausschuss und Qingdao, 30.6.2015-31.5.2016 Sitzungsleitung: Prof. M. Heizmann, Erfurt, 15.-16.11.2017, 21 Vorträge Shuhan Zhang, Vice Chief Engineer, Beijing Water Science and Technology Institute (BWSTI), China, 10.-15.10.2016 Fraunhofer VISION-Seminar mit Praktikum: Inspektion und Charakterisierung von Oberflächen, Fraunhofer IOSB, Tsend Davaa, Projektpartner, Mongolei, 21.-28.1.2017 Karlsruhe, 5.-6.12.2017 Wie Li, PhD-Student, China, seit 16.3.2017 VDI Wissensforum Big Data in the Production Line, Ausrichter: VDI, Düsseldorf, 12.12.2017, 50 Teilnehmer M.Sc. Shuhui Qu, Stanford University, 6.7.2017-7.9.2017
Sewada, Jitendra Singh, Université Grenoble Alpes, seit 4.8.2017
Prof. Dr. Jie Wang, Stanford University, 16.-21.11.2017
129 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
TRADE FAIRS AND EXHIBITIONS MESSEN UND FACHAUSSTELLUNGEN
2016 2017
Learntec 2016 AFCEA 2016 IEEE International Learntec 2017 Karlsruhe, 26.-28.1.2016 Fachausstellung 2016 Conference on Multisen- Karlsruhe, 24.-26.1.2017 Exponat: Bonn Bad Godesberg, 27.- sor Fusion and Integration Exponat: --Lost Earth 28.4.2016 for Intelligent Systems --Lost Earth und Virtual Exponate: (MFI 2016) Reality Image Exploitation Ocean International --Digitaler Lagetisch und Baden-Baden, 19.-21.9.2016 Workspace (VIEW) UK, London, 15.–17.3.2016 mobile Endgeräte Exponat: Präsentationsstand DEDAVE --Lost Earth --Experimentalsystem E-world energy & water TableSort 2017 ThEGA-Forum 2016 IFAT Essen, 7.-9.2.2017 Weimar, 18.4.2016 München, 30.5.-3.6.2016 It-sa Präsentationsstand EMS- Präsentationsstand der Gemeinschaftsstand Nürnberg, 18.-20.10.2016 EDM PROPHET®, Abteilung NRG Fraunhofer-Allianz SysWasser Exponat: Exponat: Exponat: --IT-Sicherheitslabor --EMS-EDM PROPHET® HANNOVER MESSE 2016 --Digitale Wasserlösungen Hannover, 25.-29.4.2016 Fraunhofer Vision- Myjob OWL Exponate: 7th International Confe- Technologietag Bad Salzuflen, 10.-12.3.2017 --Tiefsee-Unterwasserfahr- rence on Spectroscopic Fürth, 19.-20.10.2016 Exponat: zeug DEDAVE Ellipsometry (ICSE-7) Exponat: --Augmented Reality Handar- --m²Assist Berlin, 6.6.2016 --Deflektometrie beitsplatz --Autonomer Landroboter Präsentation des Ellipsome- IOSB.amp Q2 ters mit unserer Partnerfirma inova - Die Karrieremesse Fachforum --IT-Sicherheitslabor SENTECH Instruments GmbH an der TU Ilmenau, »Energiespeicherung mit --Smart Factory Web Ilmenau, 25.10.2016 Sektorkopplung« --Plug & Work GPEC 2016 Gemeinschaftsstand Erfurt, 13.2.2017 Leipzig, 7.-9.6.2016 »Fraunhofer in Thüringen« Fraunhofer IOSB-AST als Control 2016 – 30. Exponat: wissenschaftlicher Partner Internationale Fachmesse --Digitaler Lagetisch und VISION-VDMA- für Qualitätssicherung mobile Endgeräte Technologietag IT Sicherheitskonferenz Stuttgart, 26.-29.4.2016 Stuttgart, 8.-11.11.2016 Selbstbestimmt und sicher Gemeinschaftsstand World Conference on Präsentation des Karlsruher in der digitalen Welt Fraunhofer-Allianz Vision Non-Destructive Testing Zentrum für Material- Berlin, 14.-16.2.2017 Exponate: (WCNDT 2016) signaturen-KCM Exponat: --Deflektometrie München, 13.-17.6.2016 --IT Sicherheitslabor für --PuritySurf zur Inspektion Exponat: 6. Erneuerbare-Energien- Industrie 4.0 von Oberflächen auf --Sortiersystem blackValue Konferenz »Thüringen Beschichtungs- oder Reflek- Erneuer!bar« Industrial Vision I tanzfehler im Durchlauf Weimar, 17.11.2016 Ludwigsburg, 8.-9.3.2017 Stand mit Vorstellung Präsentationsstand Deflekto- Abteilung NRG metrie
Academix Erfurt 2016 Erfurt, 8.12.2016 Präsentation des Fraunhofer- IOSB-AST
130 CeBIT 2017 AFCEA TRAUMBERUF IT & Pol Eco System 2017 Hannover, 20.-24.3.2017 Fachausstellung 2017 TECHNIK-Schülermesse Posen, 16.-20.10.2017 Acatech-Gemeinschaftsstand Bonn Bad Godesberg, Köln, 2.6.2017 BMBF-Gemeinschaftsstand, »Vernetzte Autonome 27.-28.4.2017 Gemeinschaftsstand mit Präsentation IOSB-AST Systeme« Exponate: Fraunhofer Karriere und Exponate: --Digitaler Lagetisch: Hochschule OWL inova-Die Karrieremesse --QUANJO / Projekt SENEKA Lagevisualisierung Exponat: an der TU Ilmenau --Autonomer Bagger --Blickgesteuerter 360°-View --Roboter »Nao« Ilmenau, 24.-25.10.2017 aus dem Inneren eines Gemeinschaftsstand WASSER Fahrzeugs 5. Bayerischen Erlebnistag »Fraunhofer in Thüringen« Berlin, 28.-31.3.2017 --Lost Earth der Ernährung 2017 IWRM-MoMo Präsentation München, 25.6.2017 FMB Zuliefermesse Deterministic Ethernet Exponat: Maschinenbau HANNOVER MESSE 2017 Form --FoodScaner Bad Salzuflen, 6.-8.11.2017 Hannover, 23.-28.4.2017 Österreich, Wien, 27.-28.4.17 it’s OWL Gemeinschaftsstand Exponate: Exponat: Global Learning Council Exponat: --3D Printing in vernetzter --TSN-Demonstrator 1.0 Summit 2017 --Augmented Reality Hand- Produktion Berlin, 29.-30.6.2017 arbeitsplatz --Augmented Reality Handar- Control 2017 – 31. Exponat: beitsplatz Internationale Fachmesse --Lost Earth und Virtual 2. Fachtagung Industrie 4.0 BMBF –Gemeinschaftsstand für Qualitätssicherung Reality Image Exploitation und das Internet of Things »Autonome Systeme« Stuttgart, 9.-12.5.2017 Workspace (VIEW) Ostfildern/Stuttgart, 21.- Exponate: Gemeinschaftsstand 22.11.2017 --QUANJO / Projekt SENEKA Fraunhofer-Allianz Vision TSN/A Conference 2017 Exponat: --m²Assist Exponate: Stuttgart, 20.-21.9.17 --Augmented Reality Hand- --Digitaler Lagetisch als --Miniaturausgabe einer Exponat: arbeitsplatz oder HoloLens Kontrollstation für den Schüttgutsortier-Anlagen --TSN-Demonstrator 2.0 autonomen Bagger BoB TableSort: Prozesskette für TRAUMBERUF IT & it’s OWL Gemeinschafts- hyperspektrale Analysen IT & Media Futurecongress TECHNIK-Schülermesse stand --Deflektometrie Bielefeld, 25.9.2017 Hamburg, 22.11.2017 Exponat: Gemeinschaftsstand Digital Gemeinschaftsstand mit --VersatileProductionSystem ThEGA-Forum 2017 in NRW Fraunhofer Karriere und (VPS) Weimar, 10.5.2017 Exponat: Hochschule OWL VDI Gemeinschaftsstand Präsentationsstand der --Augmented Reality Hand- Exponat: Exponat: Abteilung NRG arbeitsplatz --Roboter »Nao« --Customized Production System (CPS) Forum ElektroMobilität BIZPLAY 2017 sps ipc drives Gemeinschaftsstand Berlin, 1.-2.6.2017 Karlsruhe, 28.9.2017 Nürnberg, 28.-30.11.2017 Mobilitec der Baden- Exponat: Exponat: Exponat: Württembergischen --Ein Angriffsszenario auf --Lost Earth und Virtual --TSN-Demonstrator 2.0 Landesagentur eMobil-BW kooperatives Fahren Reality Image Exploitation Exponate: Workspace (VIEW) E-world energy & water --Ein Angriffsszenario auf 2018 kooperatives Fahren IoT Solutions World Essen, 8.-10.2.2018 --Autonomer Bagger Spanien, Barcelona, Präsentationsstand EMS- --Lernlabor Cybersicherheit 3.-5.10.2017 EDM PROPHET®, --Smart Factory Web Exponat: Exponat: --Plug & Work --Smart Factory Web --EMS-EDM PROPHET®
131 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
PATENTS, UTILITY MODELS AND TRADEMARKS PATENTE, GEBRAUCHSMUSTER UND MARKEN
ERTEILTE PATENTE Anstett, G.; Eberle, B.; Ritt, G.: Matz, S.; Pfützenreuter, T.; Weber, D.: Verfahren und Schutzvorrichtung zur Begrenzung einer Gehäuse für Propellerantriebsaggregat optischen Leistung DE 10 2013 209 682.8 DE 10 2014 213 970.8 Erteilungsdatum: 28.12.2017 Erteilungsdatum: 20.10.2016 Michaelsen, E.; Arens, M.; Scherer-Negenborn, N.: Bernard, T.; Hain, Bogdahn, T.; Ganz, O.: Verfahren, Vorrichtung und Computerprogramm Verfahren zur Herstellung eines zylinderförmigen zur Modellauswahl bei der Objektverfolgung mit Bauteils aus Glas durch Elongieren projizierenden Messungen DE 10 2011 116806.4 DE 10 2015 223 790.7 Erteilungsdatum: 29.12.2015 Erteilungsdatum: 19.10.2016
Beyerer, J.: Pak, A.: Vorrichtung und Verfahren zur Online-Kontrolle von Vorrichtung und Verfahren zum optischen Vermessen Trinkwasser von Gegenständen mittels spiegelndem Fluss und DE 10 2007 012 970.1 Stereo-Regularisierung Erteilungsdatum: 17.2.2016 DE 10 2014 224 274 Erteilungsdatum: 22.9.2016 Brink, G.; Pfützenreuter, T.; Rauschenbach, T.: System zum Ausbringen und Bergen eines Pak, A.: Unterwasserfahrzeugs Verfahren und Vorrichtung zur Übertragung DE 20 2016 101 197.3 mechanischer Energie Erteilungsdatum: 7.6.2017 DE 10 2012 221 907.2 Erteilungsdatum: 10.11.2016 Gruna, R.; Vieth, K.-U.; Schulte, H.; Längle, T.; Hanebeck, U.; Baum, M.; Noack, B.: Ritt, G.; Eberle, B.; Anstett, G.; Ebert, R.; Beyerer, J.: Verfahren und Vorrichtung zur Schüttgutsortierung Personal Laser protection device durch prädiktive Multiobjektverfolgung EP 2012 070258 DE 10 2014 203 638. Erteilungsdatum: 1.3.2017 Erteilungsdatum: 5.12.2017 Scherer-Negenborn, N.; Lutzmann, P.; Scherer-Klöckling, C.: Hartrumpf, M.: Vorrichtung und Verfahren zur Messung von Schwingungen Vorrichtung und Verfahren zur optischen 131 987 85.1 Charakterisierung von Materialien Erteilungsdatum: 23.11.2016 DE 10 2010 046 438.4 Erteilungsdatum: 29.12.2015 Vieth, K.-U.: Verfahren zum Einrichten einer dem optischen Krempel, E.; Peinsipp-Byma, E.; van de Camp, F.; Voit, M.: Identifizieren von Objekten dienender Anlage, Labor- Vorrichtung und Verfahren zur Wiedergabe von Inhalten bildaufnahmesystem zum Durchführen eines solchen basierend auf von einem Anwender autorisierten Daten Verfahrens und Anordnung umfassend das Laborbild- DE 10 2015 206 733.5 aufnahmesystem sowie die Anlage Erteilungsdatum: 26.10.2017 DE 2012 001 868.1 Erteilungsdatum: 7.6.2017 Matz, S.; Pfützenreuter, T.; Weber, D.: Speichervorrichtung DE 10 2013 216 271.5 Erteilungsdatum: 31.5.2017
132 OFFENGELEGTE PATENTE Arens, M.; Michaelsen, E.; Meidow, J.; Hebel, M.: Jakoby, A.; Helwig, D.: System und Verfahren zur interaktiven Rekonstruktion Hardware-Kryptomodul und System zur Kommunikation von Artefakten und anderen zerlegten Gegenständen mit einer externen Umgebung DE 10 2015 205 357.1 DE 10 2013 223366.3 Offenlegungsdatum: 13.10.2016 Offenlegungsdatum: 10.3.2016
Beyerer, J.; Brink, G.: Krempel, E.; Kaufmann, M.: System zur Navigation eines autonom navigierenden Authentisierungs-Stick Tauchkörpers beim Einfahren in eine Fangstation DE 10 2014 219 297.8 EP 16 163 313.6 Offenlegungsdatum: 13.7.2017 Offenlegungsdatum: 5.10.2017 Kroschel, K.; Willersinn, D.; Chaudhary, H.; Scheers, B.; Brink, G.: van Wijngaarden, S.; Hoffmann, B.: Autonomes Unterwasserfahrzeug und Stapelvorrichtung Method and system for measuring location and / or DE 10 2016 221 597.3 orientation Offenlegungsdatum 14.12.2017 EP 16 151 513.5 Offenlegungsdatum: 20.7.2017 Brink, G.; Barth, C.: Bergevorrichtung und zugehöriges Verfahren Längle, T.; Karl, W.; Maier, G.; Bromberger, M.; Kicherer, M.; DE 10 2016 210 128.5 Becker, T.: Offenlegungsdatum: 14.12.2017 Optisches Sortiersystem sowie entsprechendes Sortierverfahren van de Camp, F.: DE 10 2016 210 482.9 Medikamentenaufbewahrungsbehälter, System zur Offenlegungsdatum: 21.12.2017 Überwachung der Entnahme eines Medikaments und Verfahren zur automatischen Füllstandsüberwachung Längle, T.; Gruna, R.; Nüßler, D.; Küter, A.; Kieninger, M.; von Medikamenten Brandt, C.: DE 10 2014 220 178.0 Vorrichtung und Verfahren zur Analyse von Materialien Offenlegungsdatum: 7.4.2016 in einem Materialstrom sowie Sortieranordnung DE 10 2016 202 530.9 Dengler, S.; Hege, C.; Eberle, B.; Muller, O.: Offenlegungsdatum: 24.8.2017 Verfahren zur Begrenzung einer optischen Leistung, Leistungsbegrenzer und damit ausgestattetes Gerät Negara, C.; Hartrumpf, M.: EP 2015 15 71 4507.9 Konfigurierbarer Retroflex-Sensor zur verbesserten Offenlegungsdatum: 15.3.2017 Charakterisierung der Eigenschaften einer Probe DE 10 2016 209 723.7 Hammer, J.-H.; Voit; M. Offenlegungsdatum: 7.12.2017 Verfahren und Vorrichtung zum kamerabasierten Messen der Position und Pose von Handwerkzeugen Negara, C.; Hartrumpf, M.: DE 10 2015 206 791.2 Vorrichtung zur Bestimmung des Polarisationszustandes Offenlegungsdatum: 20.10.2016 durch Messung von mindestens drei Stokes-Parametern DE 10 2016 209 706.7 Hartrumpf, M.; Längle, T.; Heizmann, M.; Schulte, H.; Offenlegungsdatum: 7.12.2017 Monari, E.; Vogelbacher, M., Gruna, R.: Vorrichtung und Verfahren zur Qualitätskontrolle transparenter Objekte DE 10 2014 217 771.5 Offenlegungsdatum: 9.3.2016
133 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
PATENTS, UTILITY MODELS AND TRADEMARKS PATENTE, GEBRAUCHSMUSTER UND MARKEN
Perpeet, D.; Dörfel, R.; Meidow, J.: Wortmarke »Aronnax« Verfahren zur Größenbestimmung von Flächen, DE 30 2016 103 104 Datenträger, Daten repräsentierende Signalfolie Veröffentlichungstag und Smartphone 6.4.2016 DE 10 2014 221 093.3 Offenlegungsdatum: 21.4.2016 Wortmarke »JVP« DE 30 2016 1110 265 Schatz, V.: Veröffentlichungstag Messverfahren, Messanordnung und 14.11.2016 Computerprogrammprodukt DE 10 2015 206 013.6 Wortmarke »Recomotion« Offenlegungsdatum: 6.10.2016 DE 30 2017 107 563 Veröffentlichungstag Schatz, V.: 28.7.2017 Messverfahren zur Bestimmung des Zeitverhaltens von Kameras und Messanordnung DE 10 2015 206 012.8 Offenlegungsdatum 6.10.2016
Taphanel, M.; Zink, R.: Chromatisch konfokale Sensoranordnung EP 2014 063968 Offenlegungsdatum: 7.1.2016 Bildmarke »Aronnax« Schulte, H.; Brode, T.: DE 30 2016 103 383.5 Urinanalyse im Durchfluss in Echtzeit mittels Veröffentlichungstag spektraler Messung 13.4.2016 DE 10 2015 214 926.9 Offenlegungsdatum: 19.5.2016 Wort- / Bildmarke Schulte, H.; Gruna, R.; Hofbauer, W.: »Karlsruher Vorrichtung und Verfahren zur Schimmeldetektion Forschungsfabrik« an Baustoffoberflächen DE 30 2016 102 249.3 DE 2015 219 540.6 Veröffentlichungstag Offenlegungsdatum: 13.4.2017 11.3.2016
Werling, S.; Stephan, T.: Verfahren und Vorrichtung zur Bestimmung der Wort- / Bildmarke Topografie einer Oberfläche »Lemgo Digital« DE 10 2015 203 396.1 DE 30 2017 106 985.9 Offenlegungsdatum: 25.8.2016 Veröffentlichungstag 13.7.2017 Willersinn, D.; Grinberg, M.; Kroschel, K.; Haberland, U.; Grüdel, D.; Hamm, W.: Rauschrobuste Objektortung mit Ultraschall DE 10 2014 110 187.1 Offenlegungsdatum: 21.1.2016
134 PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN
Adomeit, U.: --Member of IEEE Intelligent Transportation Systems --Mitglied der NATO-Gruppe SET-209 --Member of Society for Industrial and Applied Mathematics (SIAM) »Exploitation of Human Signatures for Threat Determination« --Member of The International Society for Optical Engineering (SPIE) --Vorsitzender der NATO-Gruppe SET-217 »Assessing and Modeling --Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung the Performance of Digital Night Vision Image Fusion« e.V. (DAGM) --Mitglied der NATO-Gruppe SET-264 --Mitglied im VDE »Short Wave Infrared Technology« --Mitglied im Beirat der Deutschen Initiative für Netzwerkinformation (DINI) Arnoldt, A.: --Mitglied im Präsidium der Deutschen Gesellschaft für Wehrtechnik --Mitglied und Vertreter der Abt. NRG des IOSB-AST im Fraunhofer- (DWT) Netzwerk Windenergie --Mitglied im Beirat der Zeitschrift »Strategie und Technik« --Mitglied im VDE / DKE Backendsysteme --Mitglied im Beirat der Zeitschrift »Europäische Sicherheit und Technik« --Mitglied im Fraunhofer EU-Netzwerk --Member of the Advisory Board of the European Journal for Security --Mitglied im IOSB EU-Netzwerk Reserarch, Springer-Verlag --International Member of the Advisory Board, Institute for Computer Azarian, A.: Science and Control (SZTAKI), Hungarian Academy of Sciences, --Mitglied der NATO-Gruppe SCI-264 »High Energy Laser Weapons: Budapest Tactical Employment in the Shared Battlespace« --Member of the Editorial Board der Buchreihe “Technologien in der intelligenten Automation”, Springer-Verlag Becker, S.: --Member of the Program Committee of the 11 Future Security, --Program Committee: SPIE Security + Defence 2016 »Optics and Berlin, 13.-14.9.2016 Photonics for Counterterrorism, Crime Fighting, and Defence« --Konferenzleiter der vom VDI Wissensforum organisierten Konferenz --Program Committee: SPIE Security + Defence 2017 »Big Data Technologien in der Produktion«, Karlsruhe, 28.-29.6.2016 »Optics and Photonics for Counterterrorism, Crime Fighting, --Awards Chair, IEEE International Conference on Multisensor Fusion Forensics and Surveillance« and Integration for Intelligent Systems (MFI 2016), Baden-Baden, 19.-21.9.2016 Beyer, D.: --Conference Chair, Machine Learning for Cyber-Physical-Systems --Mitarbeit im BITKOM ML4CPS, Karlsruhe, 29.9.2016 --Conference Chair der Conference Automated Visual Inspection and Beyerer, J.: Machine Vision, SPIE Optical Metrology, München, 25.-29.6.2017 --Vorsitzender des Fraunhofer-Verbundes für Verteidigungs- und --Conference Chair, 3. Fachkonferenz Maschinelles Lernen in der Sicherheitsforschung VVS Produktion ML4CPS, Lemgo, 25.-26.10.2017 --Mitglied des Präsidiums der Fraunhofer-Gesellschaft --Mitglied der Jury NEO2016 – Der Innovationspreis der --Mitglied des Präsidiums der Deutschen Gesellschaft für TechnologieRegion Karlsruhe Wehrtechnik e.V. --Mitglied im Programmausschuss Forum Bildverarbeitung 2016 --Mitglied des Kuratoriums des Forschungszentrums Informatik (FZI), (International Forum on Image Processing), Karlsruhe, 1.-2.12.2016 Karlsruhe --General Chair der 3nd International Conference on Optical --Vorstandsmitglied des Kuratoriums der Hochschule Karlsruhe Characterization of Materials (OCM 2017), Karlsruhe, 21.-23.03.2017 Technik und Wirtschaft --General Chair der 12th IEEE International Conference on Advanced --Leitung des Technischen Forums der Firma inspectomation GmbH, Video and Signal-based Surveillance (AVSS 2017), Karlsruhe, Mannheim 29.-1.9.2017 --Mitglied der acatech - Deutsche Akademie der Technikwissen- --Mitglied im Programmkomitee der Teilkonferenz “IT-Sicherheit für schaften e.V., München und Berlin Kritische Infrastrukturen” der Multikonferenz Wirtschaftsinformatik -- Sprecher Themennetzwerk Sicherheit, acatech - Deutsche Akademie 2018, Lüneburg, 6.-9.3.2018 der Technikwissenschaften e.V., München und Berlin (bis 07/17) --Mitglied im Programmausschuss Forum Bildverarbeitung 2018 --Stellvertretender Sprecher Themennetzwerk Sicherheit, (International Forum on Image Processing 2018), Karlsruhe, acatech – Deutsche Akademie der Technikwissenschaften e.v., 29.-30.11.2018 München und Berlin (ab 08/17) -- General Chair der 4th International Conference on Optical --Leitung der Arbeitsgruppe Lebensfeindliche Umgebungen, Characterization of Materials (OCM 2019), Karlsruhe, 13.-14.3.2019 Lernende Systeme – Die Plattform für Künstliche Intelligenz --Mitglied im wissenschaftlichen Beirat der Zeitschrift at – Auto- Bier, C.: matisierungstechnik der GMA (VDI/VDE-Gesellschaft Mess- und --Mitglied im DIN-Gremium DIN NIA AK 27-05 Automatisierungstechnik) und der NAMUR (Interessengemeinschaft Identitätsmanagement und Datenschutz-Technologie Prozessleittechnik der chemischen und pharmazeutischen Industrie) --Member of IEEE Computer Society
135 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN
Boldt, M.: Eberle, B.: --Session Chair, SPIE Europe Remote Sensing 2016, Conference: --Mitglied der NATO-Gruppe SCI-264 »High Energy Laser Weapons: »Earth Resources and Environmental Remote Sensing / GIS Appli- Tactical Employment in the Shared Battlespace« cations«, Sessions: »Processing Methodologies I« und »Processing --Mitglied der NATO-Gruppe SCI-302 Methodologies II« »DRICM Concepts & Performances« --Conference Committee Member, SPIE Europe Remote Sensing --Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« 2016 und 2017, Conference: Earth Resources and Environmental --Vorsitzender der NATO-Gruppe SET-249 »Laser Eye Dazzle–Threat Remote Sensing / GIS Applications« Evaluation and Impact on Human Performance« --Session Chair, SPIE Europe Remote Sensing 2017, Conference: --Vorsitzender der NATO-Gruppe SET-198 »Earth Resources and Environmental Remote Sensing / GIS »Visible Laser Dazzle–Effects and Protection« Applications«, Sessions: »Infrastructures and Urban Areas« und »Processing Methodologies I« Ebert, R.: -- Co-Chair Symposium SPIE Security and Defence Europe, Schottland, Bretschneider, P.: Edinburgh, 26.-29.9.2016 --Stellvertretender Sprecher Fraunhofer-Allianz Energie --Member of the Program Committee SET-241 »09th Military Sensing --Mitarbeit im BDI-Arbeitskreis »Internet der Energie« Symposium«, Kanada, Quebec, 29.5.-2.6.2017 --Vorstandsmitglied im Thüringer Erneuerbaren Energie Netzwerk --Co-Chair Symposium SPIE Security and Defence Europe, Polen, (ThEEN) Warschau, 11.-17.9.2017 --Mitglied im BMWi-Forschungsnetzwerk Energie --Mitglied des NATO SET Panel (Digitalisierung, Stromnetze) --Mitglied der Optical Society (OSA) --Mitarbeit im RIS-3 Arbeitskreis Eck, R.: Bürsing, H.: --Mitglied im Fachbereich 2 »Dienste und Anwendungen« --Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« der Informationstechnischen Gesellschaft (ITG) im VDE --Conference Chair, »SPIE – Defence & Security Europe« Eisele, C.: Bulatov, D.: --Mitglied der NATO-SET-211 Gruppe --Reviewer »Photogrammetrie – Fernerkundung – Geoinformation »Naval Platform Protection in the EO / IR Domain« (PFG)« --Mitwirkung in der EDA-Arbeitsgruppe ALWS »Airborne Platform --Reviewer »ISPRS-Journal of Photogrammetry« Effects On Laser Systems And Electro-Optical Warning Sensors« --Session Chair »Optics in Atmospheric Propagation and Adaptive Burke, J.: Systems«, Polen, Warschau, 11.-14.9.2017 --Editor, Advanced Optical Technologies -- Guest Editor für eine Special Section des Journal of Applied Remote --Program Commitee: Forum Bildverarbeitung 2016 Sensing »Optics in Atmospheric Propagation and Adaptive Systems« --Chair / Editor, SPIE Interferometry 2016 / 2017 --Mitglied der DPG --Program Commitee: Deutsche Gesellschaft für angewandte Optik 2016 / 2017 Essendorfer, B.: --Mitglied im STANAG 4559 Custodian Support Team (CST) Carmer von, C.F.: --Mitglied in der NATO-SET-211 Gruppe Fischer, Y.: »Naval Platform Protection in the EO / IR Domain« --Mitglied Technical Program Committee »CogSIMA« --Mitarbeit CSSM WG 3 an Overall Ship Signature --Tutorial Co-Chair Fusion Conference 2017 Management DEU, NLD, CAN, NOR, BEL --Mitglied VDI, AIAA, IAHR Flatt, H.: --Program Committee: »International Conference on Embedded Dimmeler, A.: Computer Systems: Architectures, Modeling and Simulation« --Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« -- Co-Chair: »IEEE International Conference on Emerging Technologies --Mitglied der NATO-Gruppe SCI-282 »Countermeasures against and Factory Automation« Anti Aircraft EO / IR Imaging Seeker Threats« --Program Committee: »International Science Conference Computer --Mitglied der NATO-Gruppe SCI-302 Networks« »DRICM Concepts & Performances« -- ZIM-Netzwerk »Optische Messtechnik & Sensorik für Industrie 4.0«, --Mitglied der NATO-Gruppe SET-240 Vertreter des IOSB-INA »Exploitation of Longwave Infrared Airborne Hyperspectral Data«
136 Geisler, J.: Hammer, H.: --Vorstand Carl-Cranz-Gesellschaft --Reviewer »Geoscience and Remote Sensing Letters (GRSL)« --Mitglied im Panel für Systems, Concepts and Integration (SCI) -- DEU-ISR Kooperation TA 29 (»Visual Processing, Multi Sensor Fusion der NATO-STO and Exploitation for ISR Applications«) --Leiter der NATO-STO Research Task Group SCI-280 on --Session Chair, SPIE Europe Remote Sensing 2017, Conference: »System-of-systems approach to task driven sensor resource »Earth Resources and Environmental Remote Sensing / GIS management for maritime situational awareness« Applications«, Session: »Processing Methodologies III«
Gladysz, S.: Heizmann, M.: --Mitglied in der NATO-SET-226 Gruppe »Turbulence mitigation for --Leitung des Fachausschusses 8.12 »Bildverarbeitung in der Electro Optics (EO) and laser systems« Mess- und Automatisierungstechnik« der VDI / VDE-Gesellschaft --Gasteditor, Journal of Applied Remote Sensing Special Section on Mess- und Automatisierungstechnik (GMA) Optics in Atmospheric Propagation and Adaptive Systems --Mitarbeit in der Arbeitsgruppe »Fertigungsmesstechnik 2020« der --Program Committee »Propagation through and Characterization of VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) Atmospheric and Oceanic Phenomena« 25.-29.6.2017, San Francisco --Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- --Chairman Conference SPIE Remote Sensing »Optics in Atmospheric Allianz Vision Propagation and Adaptive Systems«, Polen, Warschau, 10.-15.9.2017 --Leitung des Arbeitskreises --Gasteditor, Optical Engineering Special Section on »Oberflächeninspektion« am Fraunhofer IOSB Long-Range Imaging --Leitung des Fachausschusses 1.10 »Grundlagen der Messsysteme« --Reviewer for Optics Express, Applied Optics and Journal of the der VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) Optical Society of America --Mitglied des Fachbeirats des Fachbereichs 1 »Grundlagen und --Reviewer for the Irish Research Council and the US Air Force Office Methoden der Mess- und Automatisierungstechnik« der VDI / VDE- of Scientific Research Gesellschaft Mess- und Automatisierungstechnik (GMA) --Stellvertretender Vorsitzender des Fachbeirats des Fachbereichs 3 Göhler, B.: »Fertigungsmesstechnik« der VDI / VDE-Gesellschaft Mess- und --Mitglied der NATO-Gruppe SET-205 »Active Electro-Optic Sensing Automatisierungstechnik (GMA) for Target Identification and Tactical Applications« --Mitglied im wissenschaftlichen Beirat des Kooperativen Promotions- --Mitglied der NATO-Gruppe SET-232 »Computational Imaging and kollegs »Entwurf und Architektur Eingebetteter Systeme (EAES)« Compressive Sensing for EO / IR Systems« der Hochschule Pforzheim und der Universität Tübingen -- Mitglied im Wissenschaftlichen Beirat der Zeitschrift tm–Technisches Groß, W.: Messen, Verlag De Gruyter, Berlin --DEU-CHE Kooperation TV 03 »Hyperspectral Imaging« --DEU-ISR Kooperation TA 29 »Visual Processing, Multi Sensor Fusion Jacobi, M.: and Exploitation for ISR Applications« Working Group IV -- Vertreter des IOSB-AST (bis Ende 2016) im ZIM-Netzwerk Mini-ROV »Hyperspectral Remote Sensing Technologies« --Reviewer »IEEE Geoscience and Remote Sensing Letters« Jasperneite, J.: --Evaluator in EU Horizon 2020 SME Gruna, R.: --Secretary IEEE Industrial Electronics Society, Factory Automation --Mitglied im Programmausschuss »3rd International Conference on --Co-Chair des Subcommittee on »Information Technology in Optical Characterization of Materials« (OCM 2017) Industrial and Factory Automation« (IES FA 5) in der IEEE Industrial -- Associate Editor »2017 IEEE International Conference on Multisensor Electronics Society Fusion and Integration for Intelligent Systems« (MFI 2017) --Fachredaktion der ATP --Mitglied GMA-Fachausschuss 5.12 Echtzeitsysteme Haas, C.: --Mitglied GMA-Fachausschuss 6.15 Zuverlässiger Betrieb Prof. -- Mitglied im Fachbeirat der Tagung »IT-Sicherheit industrieller Ethernet-basierter Bussysteme in der industriellen Automatisierung Anlagen« --Mitglied GMA-Fachausschuss 7.21 »Industrie 4.0«-Begriffe, Referenzmodelle, Architekturkonzepte Häufel, G.: --Vorstandmitglied OWL-Maschinenbau --Session Chair, SPIE Europe Remote Sensing 2016, Conference: -- Stellvertretender Sprecher der Fraunhofer-Allianz Embedded Systems »Earth Resources and Environmental Remote Sensing / GIS Applica- -- Mitglied TuLAUT , Theorie und Lehre in der Automatisierungstechnik tions«, Session »Infrastructures and Urban Areas« --IEEE Senior Member --Session Chair, SPIE Europe Remote Sensing 2017, Conference: --Mitglied Plattform Industrie 4.0, AG 3 »Forschung & Innovation« »Earth Resources and Environmental Remote Sensing / GIS Applica- --Gutachter Österreichische Forschungsförderungsgesellschaft (FFG) tions«, Session »Environmental Monitoring IVI« --Gutachter Stiftung Rheinland-Pfalz für Innovation --Gutachter Programm ZAFH, Baden-Württemberg
137 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN
--Vorstand Internationales Promotionskolleg »Intelligente Systeme in --Gutachter des internationalen Journals »Computers and electronics der Automatisierungstechnik (ISA)« in agriculture: COMPAG« --Führungskreis Industrie 4.0, SG3 | ZVEI – Zentralverband Elektro- --Gutachter beim Helmholtz-Validierungsfonds (HVF) technik und Elektroindustrie --Gutachter für Projekte des Bundesministeriums für Bildung und Forschung (BMBF) Kaufmann, I.: -- Mitglied der NATO-Gruppe SCI-241 »Defence against UAV Attacks« Lenz, A.: --Mitglied der NATO-Gruppe SET-238 »Side-Attack Threat Detection --DEU - CHE Kooperation TV 03 »Hyperspectral Imaging« Strategies, Technologies and Techniques« Li, P.: Kerth, C.: --Mitglied der Studiengangkommission Ingenieurinformatik --Mitglied im STANAG 4559 Custodian Support Team (CST) --Mitglied der Studiengangkommission Computers and Systems --Mitglied im OGC Open Geospatial Consortium Engineering --Mitglied der Stipendienkommission der chinesischen Regierung für Kharboutli, S.: chinesische Studenten --Mitarbeit im EBC Annex 67 »Energy Flexibility in Buildings« --Beauftragter vom Rektor für den wissenschaftlichen Austausch China-Südasien Klotz, P.: --Mitglied im STANAG 4559 Custodian Support Team (CST) Löbnitz, W.: --Mitglied im IOSB Arbeitskreis Security / Sicherheit --Vertreter des IOSB-AST (ab 2017) im ZIM-Netzwerk Mini-ROV
Körber, M.: Lutzmann, P.: --Mitglied der NATO-Gruppe SET-249 »Laser Eye Dazzle–Threat --Mitglied der NATO-Gruppe SET-205 »Active Electro-Optic Sensing Evaluation and Impact on Human Performance« for Target Identification and Tactical Applications« --Mitglied der NATO-Gruppe SET-198 »Visible Laser Dazzle–Effects --Mitglied der NATO Gruppe SET-219 »Simulation of Active Imaging and Protection« Systems«
Kreißl, R.: Meidow, J.: --Vertreter des Fraunhofer IOSB-AST in der EDNA --Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung (Bundesverband Energiemarkt und Kommunikation) e.V. (DAGM) --Mitglied im VDI Kuny, S.: --Reviewer »Photogrammetrie – Fernerkundung – Geoinformation --Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung (PFG)« e.V. (DAGM) --Reviewer »ISPRS Congress 2016« --Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing« --Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing«
Längle, T.: Meyer, J.: --Paritätische Kommission zum Leistungsentgelt am Fraunhofer IOSB --Mitglied im Programmausschuss »3rd International Conference on --Leitung des Arbeitskreises »Multispektral« am Fraunhofer IOSB Optical Characterization of Materials« (OCM 2017) --Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- --Gutachter des »Journal of Applied Remote Sensing« Allianz Vision --Vertretung des Fraunhofer IOSB beim SpectroNet International Michaelsen, E.: Collaboration Cluster --Chair IAPR-TC7 (International Association for Pattern --Organisatorische Leitung und Mitarbeit im Programmausschuss des Recognition-Technical Committee 7, Remote Sensing and Mapping) »Forum Bildverarbeitung 2016« --Associate Editor, Pattern Recognition Letters, Elsevier Verlag --Gutachter und Mitglied im Programmkomitee IEEE MFI 2016 --Mitglied im Programmkomitee »SPIE Optical Metrology 2017« Middelmann, W.: --Vorsitzender im Programmausschuss und organisatorische Leitung --DEU - CHE Kooperation TV 03 »Hyperspectral Imaging« »3rd International Conference on Optical Characterization of Materials« (OCM 2017) Müller, W.: --Gutachter und Mitglied im Programmkomitee »Ilmenau Scientific --Mitglied in der Gesellschaft für Informatik e.V. (GI) Bonn Colloquium 2017- Engineering for a Changing World« --Mitglied in der NATO Imagery Working Group --Mitglied im Verein Deutscher Ingenieure (VDI) --Gutachter der Fachzeitschrift »tm-Technisches Messen«
138 Münch, D.: Richter, M.: --Program Committee: SPIE Security + Defence 2016, Optics and --Mitglied im Programmausschuss »3rd International Conference on Photonics for Counterterrorism, Crime Fighting, and Defence Optical Characterization of Materials« (OCM 2017) --Program Committee: SPIE Security + Defence 2017, Optics and Photonics for Counterterrorism, Crime Fighting, Forensics and Ritt, G.: Surveillance --Mitglied der NATO-Gruppe SET-249 »Laser Eye Dazzle-Threat Evaluation and Impact on Human Performance« Nicolai, S.: --Mitglied der NATO-Gruppe SET-198 »Visible Laser Dazzle-Effects --Vertreter des IOSB-AST im ThEEN AG »Energiespeicher« and Protection« --Leitung des Arbeitskreises ThEEN AG »Gebäude- und Energietechnik« --Mitarbeit im Forschungsnetzwerk Energie Stromnetze Rodrigues, P.: -- Beauftragter Thema Demonstrieren, Digital in NRW. Das Kompetenz- Niggemann, O.: zentrum für den Mittelstand in NRW --Mitglied Cooperation im AutomationML Gremium --Mitglied GMA Fachausschuss 7.20 Cyber-physical Systems Röcker, C.: --Mitglied GMA-Fachausschuss 5.58 Middleware --Mitglied Australian Research Council (ARC) --Sprecher Internationales Promotionskolleg »Intelligente Systeme in --Mitglied Luxembourg National Research Fund (FNR) der Automatisierungstechnik« (ISA) --Mitglied IEEE Technical Committee on Industrial Automated --Mitglied TuLAUT, Theorie und Lehre in der Automatisierungstechnik Systems and Control --Mitglied InnovationsZentrum für Internettechnologie und Paunescu, G.: Multimediakompetenz, InnoZent OWL e. V. --Mitglied der NATO-Gruppe SET-232 »Computational Imaging and --Vorstand Internationales Promotionskolleg »Intelligente Systeme Compressive Sensing for EO / IR Systems« in der Automatisierungstechnik (ISA)« --Mitglied Nationale Plattform Elektromobilität (NPE) Peinsipp-Byma, E.: --Mitglied Gesellschaft für Informatik Roller, W. --Reviewer der Zeitschrift »at-Automatisierungstechnik« --Mitglied Bitkom Arbeitskreis »Learning Solutions«
Pethig, F.: Sander, J.: --Mitglied Plattform Industrie 4.0, AG 1 --Mitglied im »Technical Programm Commitee« der 19th International »Referenzmodelle, Standardisierung & Normung«, UAG Ontologie Conference on Information Fusion (FUSION 2016) --Mitglied im »Technical Programm Commitee« der 20th International Pfützenreuter, T.: Conference on Information Fusion (FUSION 2017) -- Vertreter des IOSB-AST in der Gesellschaft für Maritime Technik e.V. --Mitglied im Program Committee »20th World Multi-Conference on --Vertreter des IOSB-AST im Subsea Monitoring Network Systemics, Cybernetics and Informatics« (WMSCI 2017)
Rauschenbach, T.: Sauer, O.: --Mitglied des VDI / VDE GMA-Fachausschuss 5.14 -- Mitglied im Interdisziplinären Gremium Digitalisierung‘ des VDI. »Computational Intelligence« -- Leitung des VDI-GPL-Richtlinienausschusses »Digitaler Fabrikbetrieb« --Mitglied der Gesellschaft für Maritime Technik (GMT) -- Mitglied im VDI-GPL-Fachausschuss »Digitale Fabrik« --Mitglied im VDE -- Mitglied im VDI-GPP-Fachausschuss »MES« --Mitglied Fraunhofer Allianz SysWasser -- Mitglied des VDI-GPP-Richtlinienausschusses --Mitglied der Foren bei German Water Partnership »Logische Schnittstelle MES-Maschine« (Länderforen China und Vietnam) -- Mitglied in der VDA-ITA --Mitglied in Deep Sea Mining Alliance »Informationstechnologie für die Automobilindustrie« --Mitglied im CIRP »STC »O« Optimization of Manufacturing Systems« Renkewitz, H.: -- Mitglied in der »OPC Foundation« --Vertreter des IOSB-AST im Subsea@Fraunhofer Netzwerk -- Mitglied des Automotive Engineering Netzwerks Südwest -- Vorstand Wirtschaftsstiftung Südwest Repasi, E.: -- Mitglied im VDI-Fachausschuss Modellierung und Simulation --Mitglied der NATO Gruppe SET-219 »Simulation of Active Imaging -- Mitglied im Fachbeirat Digitale Fabrik@Produktion Systems« -- Erstansprechpartner des IOSB in der Innovationsallianz der --Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Technologieregion Karlsruhe Compressive Sensing for EO / IR Systems«
139 NAMES, DATES, EVENTS NAMEN, DATEN, EREIGNISSE
PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN
Scharaw, B.: Schwegmann, A.: --Head of Section Central Asia, GWP --Mitglied der NATO-SCI-284 Gruppe »Assessment Methods for --Mitglied des wissenschaftlichen Rates der Deutsch-Mongolischen Camouflage in Operational Context « Gesellschaft --Mitglied im Kharaa River Basin Administration Schweitzer, C.: -- Mitglied in der NATO-SCI-279 Gruppe »Enabling Technical Conside- Schönbein, R.: rations for a NATO-Common Space Domain Operating Picture« --Mitglied der Deutschen Gesellschaft für Wehrtechnik e.V., Bonn --Mitglied in der NATO-SCI-283 Gruppe »Considerations for Space --Mitglied der Human Factors and Ergonomics Society, USA, and Space-Enabled Capabilities in NATO Coalition Operations« Santa Monica, Kalifornien --Mitglied in der NATO-SCI-285 Gruppe »Space Domain Effects on --Mitglied im Fachausschuss T 5.4 Anthropotechnik; Deutsche NATO Operations« Gesellschaft für Luft- und Raumfahrt (DGLR) --Vertretung des IOSB in der Fraunhofer-Allianz Space -- Mitglied im editorial board of the International Journal on Advances in Systems and Measurements (IARIA Journals) Seiffer, D.: --Mitglied im Programmausschuss ICONS --Mitglied in der NATO-SET-234 Gruppe »Environmental limitations of fielded EO-TDAs« Schriegel, S.: -- Deutscher Vertreter in der EDA-Arbeitsgruppe ALWS »Airborne Plat- --Profibus International-PNIO-AK TSN form Effects On Laser Systems And Electro-Optical Warning Sensors« --Member of Program Committee, »Technologies for Optical Schulte, H.: Countermeasures« bei der SPIE Security + Defence --Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- Allianz Food Chain Management (FCM) Sprung, D.: --Mitglied im Programmausschuss »3rd International Conference on --Mitwirkung in der Kooperation mit dem Kiepenheuer-Institut für Optical Characterization of Materials« (OCM 2017) Solarphysik (KIS), Freiburg, »Bestimmung der optischen Turbulenz am Observatorium VTT auf dem Teide / Teneriffa, Spanien« Schulz, K.: --Mitwirkung in der deutsch-israelischen Arbeitsgruppe mit dem --Conference Chair, SPIE Europe Remote Sensing 2016 und 2017, Soreq / Israel »Wind and turbulence measurements« Conference: Earth Resources and Environmental Remote Sensing / --Mitwirkung in der deutsch-südafrikanischen Kooperation mit dem GIS Applications SCIR Südafrika zu »Determination of the vertical distribution of --Session Chair, SPIE Europe Remote Sensing 2016, Conference: optical turbulence over savannah« Earth Resources and Environmental Remote Sensing / GIS Appli- --Reviewer for Optical Engineering, Applied Optics and Journal of cations, Sessions: »Sensors and Platforms« und »Environmental the Optical Society of America A (OSA) Monitoring Concepts IV« -- Kooperation mit dem ISL / Frankreich, Betreuung einer Doktorarbeit --Session Chair, SPIE Europe Remote Sensing 2017, Conference: (2017) Earth Resources and Environmental Remote Sensing / GIS Appli- --Mitwirkung Projekt EORAD, Kooperation mit Universität Delft / NL cations, Sessions: »Environmental Monitoring I« und »Processing (Sukanta Basu, S. Gladysz D. Sprung, I. Toselli, K. Stein) Methodologies II« --DEU - ISR Kooperation TA 29 »Visual Processing, Multi Sensor Stein, K.: Fusion and Exploitation for ISR Applications« Working Group IV -- Chairman Conference SPIE Remote Sensing, »Optics in Atmospheric »Hyperspectral Remote Sensing Technologies« Propagation and Adaptive Systems« Warschau, 10.-15.9.2017 --Member of IEEE Geoscience and Remote Sensing Society --Chairman Conference SPIE Security & Defence, »Target and --Mitglied NATO-RTO-SCI-248 »Vulnerability of NATO operations Background Signatures«, Warschau, 10.-15.9.2017 to current and future commercial space-based Synthetic Aperture -- Chairman Conference SPIE Remonte Sensing »Optics in Atmospheric Radar (SAR) sensors« Propagation and Adaptive Systems«, Edinburgh, 25.-29.9.2016 --Mitglied NATO-RTO-SET-220 »Geospatial Information Extraction --Chairman Conference SPIE Security & Defence, »Target and From space-Borne SAR-Images for NATO-Operations« Background Signatures«, Warschau, Edinburgh, 25.-29.9.2016 --Reviewer »Journal of at - Automatisierungstechnik« --Mitglied der NATO-SET-211 Gruppe »Naval Platform Protection in --Reviewer »Deutsche Forschungsgemeinschaft (DFG)« the EO / IR Domain« --Mitglied in der NATO-SCI-ET-013 Gruppe »Evaluation Methods Schwarz, A.: and Assessment of Camouflage in Operational Context« -- Mitglied in der NATO SET-ET-096 Gruppe »Smart Textiles, Wearables --Chairman in der NATO-SCI-ET-017 Gruppe »Development of and Sensors for the Integration of Soldier / System Capabilities« Methods for Measurements and Evaluation of Natural Background --Leitung CCG-Kurs »Signaturmanagement« SE 2.14 Colours« --Mitglied in der NATO-SCI-283 Gruppe »Considerations for Space and Space-Enabled Capabilities in NATO Coalition Operations«
140 --Mitglied der NATO-SCI-284 Gruppe »Assessment Methods for Westermann, D.: Camouflage in Operational Context« --Mitglied im CIGRE National Committee Germany --Mitglied der NATO-SCI-291 Gruppe »Scenarios for Assessment --Mitglied im CIGRE DAK C2 – System Operation Methods for Camouflage in Operational Contexts« -- Mitglied in CENELEC TC 8X/WG 06 – System Aspects of HVDC Grids -- Mitglied der NATO-SCI-295 Gruppe »Development of Methods for --Mitglied in IEC UK 121.1 – Short Circuit Current Calcuation for Measurements and Evaluation of Natural Background EO Signatures« HVDC Grids --SCI-Panel, Member at Large --Mitglied in IEEE WG on »Practical Technologies for VSC HVDC --Leitung Kurs »Warnsensorik« SE 3.11 der Carl-Cranz-Gesellschaft e.V. Systems« / IEEE WG on »Planning for HVDC« --Leitung der IEEE Energy Development and Power Generation, Stricker, R.: Industry Practice Subcommittee, WG Europe (HVDC Panel @ GM) --Mitglied der Studienkommission des Fachbereichs Informatik an --Mitglied IEEE Germany Section »Industry Relation Officer« der Hochschule Zittau-Görlitz --Mitglied IEEE PES Germany Chapter »Treasurer« --Sprecher der RIS 3 Arbeitsgruppe »Energie und Ressourceneffizienz« Taphanel, M.: – Freistaat Thüringen --Mitglied im Programmausschuss »3rd International Conference on --Mitglied im FNN Lenkungskreis HS-HoeS Netze Optical Characterization of Materials« (OCM 2017) -- Reguläres Mitglied in der Sächsischen Akademie der Wissenschaften, --Mitglied der Deutsche Physikalische Gesellschaft (DPG) Technikwissenschaftliche Klasse --Mitglied im PTJ Forschungsnetzwerk Energie – Stromnetze Tchouchenkov, I.: --Mitglied im wissenschaftlicher Beirat 50Hertz Transmission GmbH --Mitglied GMA-Fachausschusses 5.15 »Agentensysteme« --Mitglied Direktorium Institut für Energiewirtschaftsrecht an der FSU Jena Thiele, A.: --Mitglied im wissenschaftlicher Beirat Energiecampus Nürnberg --Reviewer »Photogrammetrie – Fernerkundung – Geoinformation --Mitglied in der Scientific Reference Group »ProMotion« (PFG)« -- Direktor des Instituts für Elektrische Energie- und Steuerungstechnik --Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing« --Leiter Studiengangskommission Masterstudiengang »Elektric Power and Control Engineering« Usländer, T.: --Mitglied Studiengangskommission Diplomstudiengang Elektrotechnik --Co-Chair der Session »Resilience: Methods, Tools and Indications« und Informationstechnik der IDRC, Schweiz --Vorsitzender Prüfungsausschuss Elektrotechnik und Informations- --Mitglied im Advisory Board der Digital Innovation Group technik --Vorsitzender Prüfungsausschuss Electrical Power and Control Wagner, B.: Engineering --Mitglied in der DGfK (Deutsche Gesellschaft für Kartographie e.V.) --Mitglied im OGC (Open Geospatial Consortium) Willersinn, D.: --Mitglied des wissenschaftlichen Beirats des Heidelberger Warweg, O.: Bildverarbeitungsforums --Mitarbeit im VDE / ITG Energieinformationsnetze --Mitglied VDE Arbeitskreis Smart Grids Winkelmann, M.: --Mitarbeit und Vertreter des Fraunhofer IOSB-AST in der Fraunhofer --Deutscher Vertreter in der Arbeitsgruppe »Multispectral Camouflage Allianz Big Data Concealment and Deception« der deutsch-israelischen Kooperation --Vertreter des Fraunhofer IOSB-AST in der Fraunhofer Academy --Mitglied in der NATO-SCI-270 Gruppe »Process Development for --Mitarbeit und Vertreter des IOSB-AST im Netzwerk eMobilityCity D&D Field Trials and Associated Data Analysis« --Vertreter des Fraunhofer IOSB-AST in der EDNA -- Mitglied der NATO-SCI-295 Gruppe »Development of Methods for (Bundesverband Energiemarkt und Kommunikation) Measurements and Evaluation of Natural Background EO Signatures«
Wegner, D.: --Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Compressive Sensing for EO / IR Systems«
Wenzel, A.: --Mitglied Fraunhofer Allianz Embedded --Mitglied VDI / VDE-GMA FA 7.20 Cyber Physical Systems
141 YOU FIND SCIENTIFIC PUBLICATIONS ON THE WEB. ABSTRACTS AND WHOLE TEXTS: www.iosb.fraunhofer.de > Publications
WISSENSCHAFTLICHE VERÖFFENTLICHUNGEN FINDEN SIE IM WEB. ABSTRACTS UND VOLLTEXTE UNTER: www.iosb.fraunhofer.de > Publikationen
TEACHING ACTIVITIES LEHRTÄTIGKEITEN
Arens, M.: Jasperneite, J.: -- Einführung in die Bildfolgenauswertung, SS 2016, SS 2017 Fakultät -- Rechnernetze, SS 2017 für Informatik, Karlsruher Institut für Technologie (KIT) -- CDS (IT-Master), SS 2017 -- Protocol Engineering (VP-RN), WS 2017/18 Atorf, D.; Berger, A.: -- Weitverkehrsnetze, WS 2017/18 -- Praxis der Softwareentwicklung, SS 2017 -- Maschinennahe Vernetzung, WS 2017/18 -- Lehrveranstaltung in Kooperation mit dem Lehrstuhl Programmier- -- TechStartup, WS 2017/18 Fachbereich Elektrotechnik und Technische paradigmen für die Fachrichtung Informatik zur Entwicklung eines Informatik, Hochschule Ostwestfalen-Lippe, Lemgo mittelgroßen Systems im Team mit Objektorientierter Software- technik, hier: Entwicklung eines Prototyps zu Crayons 2.0 Fakultät Kannegieser, E.; Atorf, D.; Streicher, A.: für Informatik, Karlsruher Institut für Technologie (KIT) -- Seminar zum Technologiegestützten Lernen (TGL), SS 2016, SS 2017 Seminar in Kooperation mit dem Forschungszentrum Informatik (FZI), Beyerer, J.: der Hochschule Karlsruhe für Technik und Wirtschaft (HsKa) und -- Mustererkennung, SS 2017, SS 2018 dem Institut für Berufspädagogik (KIT/IBP) für die Fachrichtungen -- Automatische Sichtprüfung und Bildverarbeitung, Informatik, Informationswirtschaft und Wirtschaftswissenschaften, WS 2016/2017, WS 2017/2018 Fakultät für Wirtschaftswissenschaften und Fakultät für Geistes- und -- Seminar: Technologiegestütztes Lernen, SS 2017 Sozialwissenschaften, Karlsruher Institut für Technologie (KIT) -- Seminar: Bildauswertung und -fusion, SS 2017 --Proseminar: Anthropomatik: Von der Theorie zur Anwendung, SS Längle, T.: 2017, WS 2017/2018 (gemeinsam mit Prof. Uwe Hanebeck) -- Projektpraktikum Robotik und Automation I+II, SS 2016 --Projektpraktikum Bildauswertung und -fusion, WS 2017/2018 -- Echtzeitsysteme, SS 2016 --Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) -- Projektpraktikum Robotik und Automation I+II, WS 2016/2017 Bretschneider, P.: -- Einführung in die Informatik für Naturwissenschaftler und Ingenieure -- Energieprognose im Rahmen der SS-Vorlesung von Professor I, WS 2016/2017 Projektpraktikum Robotik und Automation I+II, SS Westermann, Elektrische Energieversorgung ESIII, SS 2016 2017 -- Energieeinsatzoptimierung - Grundlagen, SS 2017 -- Projektpraktikum Robotik und Automation I+II, -- Energieeinsatzoptimierung - Multimodale Energiesysteme, WS 2017 WS 2017/2018 Fakultät für Informatik, Fakultät für Elektrotechnik und Informationstechnik, Technische Karlsruher Institut für Technologie (KIT) Universität Ilmenau -- Kognitive Systeme, WS 2016/2017 -- Kognitive Systeme, WS 2017/2018 Dutschk, B.; Uhlig, D.; Heizmann, M.: Duale Hochschule Baden-Württemberg (DHBW) Karlsruhe -- Praktikum Mechatronische Messsysteme, SS 2017 Fakultät für Elektrotechnik und Informationstechnik, Li, P.: Karlsruher Institut für Technologie (KIT) -- Control Engineering, WS 2015/16, WS 2016/17, WS 2017/18 Flatt, H.: -- Regelungs- und Systemtechnik 2, WS 2015/16, WS 2016/17, WS -- Embedded Systems Design, WS 2017/18 2017/18 Fachbereich Elektrotechnik und Technische Informatik, Hochschule -- Prozess- und Umweltsystemtechnik, WS 2015/16, Ostwestfalen-Lippe, Lemgo WS 2016/17, WS 2017/18 -- Regelungs- und Systemtechnik 1, SS 2016, SS 2017 Geisler, J.: -- Regelungs- und Systemtechnik 3, SS 2016, SS 2017 -- Mensch-Maschine-Wechselwirkung in der Anthropomatik: Basiswis- -- Dynamische Prozessoptimierung, SS 2016, SS 2017 sen, WS 2016/2017 -- Prozessoptimierung 1, SS 2016, SS 2017 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Heizmann, M.: -- Verteilte Messsysteme, 23.-27.5.2016, Blockveranstaltung am Chi- Maier, A.: nesisch-Deutschen Hochschulkolleg (CDHK) der Tongji-Universität, -- Algorithmen und Datenstrukturen, WS 2017/18 Shanghai, China Institut für industrielle Informationstechnik, -- Fertigungsmesstechnik, SS 2016, SS 2017 Hochschule Ostwestfalen-Lippe, Lemgo -- Messtechnik in der Mechatronik, WS 2016/2017 --Informationsfusion, WS 2016/2017 Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT)
142 Meidow, J.: Scharaw, B.: -- Bildsequenzanalyse, WS 2016/2017 -- Integrated Urban water management, 10.-12.3.2016, 14.- Fakultät für Bauingenieur-, Geo- und Umweltwissenschaften, 16.6.2016, 20 -23.9.2016 Karlsruher Institut für Technologie (KIT) Technology Mongolian University of Science and Technology, Faculty of Construction and Water Niggemann, O.: --China Agricultural University in Hohhot (China), 08.-12.8.2016 -- Machine Learnig, WS 2017/18 Hydrology Institute in Ilmenau -- Algorithms and Data Structures, WS 2017/18 -- Ground water management, 27.-28.2.2017 -- Theoretical Computer Science, WS 2017/18 China Agricultural University in Hohhot (China), -- The Art of Written and Oral Presentations, SS 2017 Hydrology Institute in Ilmenau Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo Wenzel, A.: -- Embedded Systems, WS 2015/16, WS 2016/17, WS 2017/18 Pak, A.: -- Mikrocontrollertechnik, WS 2015/16, WS 2016/17, -- Bilddatenkompression, WS 2016/17 WS 2017/18 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) -- Mikroprozessortechnik, SS 2016, SS 2017 Fakultät für Elektrotechnik, Hochschule Schmalkalden Peinsipp-Byma, E.; Sauer, O.: -- Gestaltungsgrundsätze für Interaktive Echtzeitsysteme, Westermann, D.: SS 2016, SS 2017 -- Grundlagen der elektrischen Energiesystem- und Anlagentechnik– Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) EPCE, WS 2015/16, WS 2016/17, WS 2017/18 -- Grundlagen des Betriebs und Analyse elektrischer Pieper, C.: Energiesysteme, SS 2016, SS 2017 -- Hardware eingebetteter Systeme, SS 2017 -- Netzleittechnik und Energiemanagementsysteme, SS 2016, SS 2017 Institut für industrielle Informationstechnik, -- Netzdynamik, HGÜ und FACTS, WS 2015/16, WS 2016/17, WS Hochschule Ostwestfalen-Lippe, Lemgo 2017/18 --Modellbildung und Simulation in der Energietechnik, SS 2016, SS Rauschenbach, T.: 2017 -- Diagnose- und Vorhersagesysteme, WS 2015/16, Fakultät für Elektrotechnik und Informationstechnik, WS 2016/17, WS 2017/18 Technische Universität Ilmenau Technische Universität Ilmenau, Fakultät für Informatik und Automatisierung Windmann, S.: -- Blockseminar Programmiersprachen 2, SS 2017 Röcker, C.: -- Vorlesung Programmiersprachen 1, WS 2017/18 -- Vorlesung Verteilte Systeme, SS 2017 Institut für industrielle Informationstechnik, -- Übung Verteilte Systeme, SS 2017 Hochschule Ostwestfalen-Lippe, Lemgo -- Vorlesung Mensch-Maschine-Interkation, SS 2017 -- Übung Mensch-Maschine-Interkation, SS 2017 Zaschke, C.; Kerth, C.: -- Vorlesung Rechnerorganisation und Betriebssysteme, --Kooperation mit der Forschungsgruppe C&M des KIT, SS 2017 WS 2017/18 -- Betreuung studentischer Arbeiten mit den Themenschwerpunkten -- Übung Rechnerorganisation und Betriebssysteme, Domain-driven Design (DDD) und Microservices in Kooperation mit WS 2017/18 der Forschungsgruppe Cooperation & Management (C&M) von Herr -- Vorlesung Usability Engineering, WS 2017/18 Prof. Abeck -- Übung Usability Engineering, WS 2017/18 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) -- Vorlesung User Experience und Interaction Design, WS 2017/18 -- Übung User Experience und Interaction Design, WS 2017/18 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo
Ruf, B.: --Grundlagen der Computer Grafik, SS 2016, SS 2017 Fakultät für Technik, Duale Hochschule Baden-Württemberg, Ravensburg
143 DISSERTATIONS DISSERTATIONEN
Aissa, Tarek: Münch, David: Systemidentifikation und Reglersynthese für örtlich verteilte Begriffliche Situationsanalyse aus Videodaten bei unvollständi- Prozesse durch adaptive Takagi-Sugeno Fuzzy Systeme am ger und fehlerhafter Information Beispiel des Raumklimaverhaltens Fakultät für Informatik, Fakultät für Informatik und Automatisierung, Karlsruher Institut für Technologie (KIT) Technische Universität Ilmenau Petereit, Janko: Belkin, Andrey: Adaptive State × Time Lattices: A Contribution to Mobile World Modeling for Intelligent autonomous Systems Robot Motion Planning in Unstructured Fakultät für Informatik Dynamic Environments Karlsruher Institut für Technologie (KIT) Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Birnstill, Pascal: Privacy-Respecting Smart Video Surveillance Based on Usage Qu, Chengchao: Control Enforcement Facial Texture Super-Resolution by Fitting 3D Face Models Fakultät für Informatik, Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Karlsruher Institut für Technologie (KIT)
Boldt, Markus: Stephan, Thomas: Änderungsanalyse in Zeitreihen hochaufgelöster SAR- Beitrag zur Unterwasserbildrestauration Satellitenbilder Fakultät für Informatik, Fakultät für Bauingenieur-, Geo- und Umweltwissenschaften, Karlsruher Institut für Technologie (KIT) Karlsruher Institut für Technologie (KIT) Trommer, Maria: Grinberg, Michael: Ein Beitrag zur Anwendung von Support-Vektor-Maschinen zur Feature-Based Probabilistic Data Association for Video-Based robusten nichtlinearen Klassifikation komplexer biologischer Multi-Object Tracking Daten Fakultät für Informatik, Fakultät für Informatik und Automatisierung, Karlsruher Institut für Technologie (KIT) Technische Universität Ilmenau
Höfer, Sebastian: Woock, Philipp: Untersuchung diffus spiegelnder Oberflächen mittels Infrarot- Umgebungskartenschätzung aus Sidescan-Sonardaten für ein deflektometrie autonomes Unterwasserfahrzeug Fakultät für Informatik Fakultät für Informatik, Karlsruher Institut für Technologie Karlsruher Institut für Technologie (KIT)
Janya-anurak, Chettapong: Framework for analysis and identification of nonlinear distributed parameter systems using Bayesian uncertainty quantification based on generalized polynomial chaos Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
Krempel, Erik: Steigerung der Akzeptanz von intelligenter Videoüberwachung in öffentlichen Räumen Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
Moßgraber, Jürgen: Ein Rahmenwerk für die Architektur von Frühwarnsystemen Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
144 LECTURES 2016 VORTRÄGE 2016
Adomeit, U.: Becker, S.; Scherer-Negenborn, N.; Thakkar, P.; Hübner, W.; Arens, M.: Grundlagen und neueste Entwicklungen der Nachtsichttechnik. An evaluation of background substraction algotrithms on 4. KSK Symposium Rüstung, Wart, 21.9.2016 fused infrared-visible video streams. International Conference on Digital Image Computing: techniques and Applications (DICTA 2015), Adomeit, U.: Australien, Adelaide, 23.-25.11.2015 Verfahren zur Leistungssteigerung von Wärmebildgeräten. Seminar SE 1.02 »Infrarottechnik – Grundlage, Trends und moderne Becker, S.; Kieritz, H.; Hübner, W.; Arens, M.: Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, On the benefit of state separation for tracking in image 18.10.2016 space with an interacting multiple model filter. International Conference on Image and Signal Processing (ICISP) 2016, Kanada, Adomeit, U.; Schuberth, W.: Trois-Rivières, 30.5.-1.6.2016 Thermisches Reichweitenmodell zur Punktzielauffassung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegen- Becker, S.; Krah, S.; Hübner, W.; Arens, M.: maßnahmen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, MAD for visual tracker fusion. SPIE Security + Defence 2016, UK, 17.11.2016 Edinburgh, 26.-29.9.2016
Adomeit, U.: Becker, S.; Scherer-Negenborn, N.; Thakkar, P.; Hübner, W.; Arens, M.: IR-Detektorentwicklung. Seminar SE 3.11 »Warnsensorik (UV, IR, The effects of camera jitter for background substraction mmW, Terahertz) und Gegenmaßnahmen« der Carl-Cranz- algorithms on fused infrared-visible video streams. Gesellschaft e.V., Oberpfaffenhofen, 17.11.2016 SPIE Security + Defence 2016, UK, Edinburgh, 26.-29.9.2016
Anneken, M.; Fischer, Y.; Beyerer, J.: Bergmann, S.; Mohammadikaji, M.; Irgenfried, S.; Wörn, H.; Beyerer, J.; Anomaly Detection using B-Spline Control Points as Feature Dachsbacher, C.: Space in Annotated Trajectory Data from the Marine Domain. A Phenomenological Approach to Integrating Gaussian Beam International Conference on Agents and Artificial Intelligence, Italien, Properties and Speckle into a Physically-Based Renderer. Vision, Rom, 24.-26.2.2016 Modeling, and Visualization 2016, Bayreuth, 12.10.2016
Anneken, M.; Fischer, Y.; Beyerer, J.: Bernard, T.: Detection of conspicuous behavior in street traffic by using Innovative software platform and sensors for the detection B-Splines as feature vector. 11th Future Security; Berlin, 13.-14.9.2016 and mitigation of CBRN related contamination events of drinking water (SAFEWATER). Vortrag bei 6th SWAN Conference, Anneken, M.: UK, London, 6.4.2016 Detektion von auffälligem Verhalten in räumlich-zeitlichen Datensätzen. Technologie Tag Verteidigung des Fraunhofer IOSB, Bernard, T.: Karlsruhe, 18.10.2016 Neuartige Sensoren und Software-Tools zu Online-Monitoring, Qualitätsüberwachung und Schadens-minimierung bei Arnoldt, A.; Klarner, T.; Ritter, S.; Warweg, O.: CBRN-Kontaminationen in Trinkwasser-netzen (SAFEWATER). Optimized provision of minute reserve capacity products by ÖVGW-Kongress und Fachmesse Gas Wasser 2016, Österreich, Wels, controlled charging of electric vehicles. EEM2016-IEEE European 21.4.2016 Energy Market, Portugal, Porto, 6.-9.6.2016 Bernard, T.: Azaiez, S.; Boc, M.; Cudennec, L.; Da Silva Simoeasa, M.; Haupert, J.; On-line Monitoring of Drinking Water Based on a Biological Kchir, S.; Klinge, X.; Labidi, W.; Hahhal, K.; Pfrommer, J.; Schleipen, M.; Broad-Spectrum Sensor (AquaBioTox). 1st International Symposium Schulz, C.; Tortech, T.: on Mobile Water Supply in Operations: Research and Field Experience Towards flexibility in Future Industrial Manufacturing: Munster, Münster, 7.-9.6.2016 A Global Framework for Self-Organization of Production Cells. RAMCOM 2016, Spanien, Madrid, 23.-25.5.2016 Bernard, T.: SAFEWATER-Innovative tools for the detection and mitigation Batz, T.: of CBRN related contamination events of drinking water. Water Co-Design of Requirements and Architectural Artefacts for Innovation Europe 2016 (WIE2016), Belgien, Brüssel, 21.6.2016 Industrial Internet Applications. 7th International Symposium on Information Management in a Changing World, Österreich, Wien, Bernard, T.: 10.-11.10.2016 Cloud-based event detection platform for water distribution net- works using machine-learning algorithms. Konferenz »Machine Learn- ing for Cyber-Physical-Systems«, Fraunhofer IOSB, Karlsruhe, 29.9.2016
145 LECTURES 2016 VORTRÄGE 2016
Bernard, T.: Beyerer, J.: Online Hydraulic and Water Quality Simulator as a Tool for High-Level Umweltmodelle als Gedächtnisstruktur für die Contamination Event Response. Conference Computing and Wahrnehmung intelligenter technischer Systeme. Research Camp Control in the Water Industry (CCWI 2016), Niederlande, Amsterdam, der Junior Research Class, Fraunhofer-Gesellschaft, Waischenfeld, 9.11.2016 18.-19.8.2016
Bernard, T.: Beyerer, J.: SAFEWATER - Innovative tools for the detection and mitigation Viele Augen – Ein Bild – Optronische Sicht und deren technische of CBRN related contamination events of drinking water. Nutzung für die Landstreitkräfte der Zukunft. Symposium des SAFEWATER Final Conference-International Conference on Water Förderkreises Deutsches Heer e.V.: »Forschung und Technologie Security, Schweiz, Zürich, 23.11.2016 für die Landstreitkräfte mit Zeithorizont 2030+ - Vom Labor in den Einsatz«, Freiburg, 11.-12.10.2016 Bernard, T.: SAFEWATER - Innovative tools for the detection and mitigation Beyerer. J.: of CBRN related contamination events of drinking water. Blick in die Fraunhofer-Labore: Das IT-Sicherheitslabor für Water Safety and Security Workshop der Europäischen Kommission die industrielle Produktion. Fraunhofer-Tag der Cybersicherheit, (DG Home), Belgien, Brüssel, 12.12.2016 »Sicher in die digitale Zukunft«, Berlin, 20.10.2016
Beyer, D.; Ruhe, S.; Bretschneider, P.: Beyerer, J.: Results of a Monte Carlo based Risk Analysis on the Impact Autonome Systeme. Fraunhofer Strategie Klausur, Leipzig, of PEVs to the Distribution Grid. IEEE EnergyCon 2016, Belgien, 2.-4.11.2016 Leuven, 4.-8.4.2016 Beyerer, J.: Beyerer, J.: From Pictures to Semantics – How to Extract Meaning from Maschinelles Lernen für die Überwachung und Optimierung Image Data. Jenoptik AG, Sindelfingen, 16.11.2016 von Produktionsprozessen. Strategische Fokustage Maschinelles Lernen, München, 11.2.2016 Bretschneider, P.; Herzog, R.; Bernard, T.; Tippmann, V.; Warweg, O.; Naumann, S.: Beyerer, J.: Mit dem Internet der Dinge vom Gebäude- zum Stadtteil-Energie- Forschungsschwerpunkte beim VVS. Angewandte Forschung management. VDE Kongress 2016, Mannheim, 7.-8.11.2016 für Verteidigung und Sicherheit in Deutschland. Veranstaltung der Studiengesellschaft der DWT MbH in Zusammenarbeit mit BMVg, F&T- Bier, C.; Kühne, K.; Beyerer, J.: Ausschuss des BDSV, Fraunhofer VVS und DLR, Bonn, 23.-25.2.2016 PrivacyInsight: The Next Generation Privacy Dashboard. 4th Annual Privacy Forum, APF 2016, Frankfurt a. M., 7.-8.9.2016 Beyerer, J.: Neue Technologien für die Terrorismusabwehr. Fachveranstaltung Bier, C.: der Fraunhofer-Gesellschaft für die deutschen Polizeibehörden. Ansatz zur Berechnung des Linkage-Risikos in Informations- Fraunhofer IOSB, Karlsruhe, 8.3.2016 flüssen. Future Security 2016, Berlin, 13.-14.9.2016
Beyerer. J.: Birnstill, P.; Bier, C.; Wagner, P.; Beyerer, J.: Geschäftsmodelle für den effektiven und schnellen Technologie- Generic Semantics Specification and Processing for Inter-System transfer von Fraunhofer in die Polizeibehörden; Formate und Information Flow Tracking. 15th International Conference on Prozesse. Fachveranstaltung der Fraunhofer-Gesellschaft für die Security and Management, USA, Las Vegas, Nevada, 25.-28.7.2016 deutschen Polizeibehörden. Fraunhofer IOSB, Karlsruhe, 8.3.2016 Bodensteiner, C.; Bullinger, S.; Lemaire, S.; Arens, M.: Beyerer, J.: Single frame based video geo-localisation using structure Videoüberwachung und Mensch-Maschine-Interaktion – Tech- projection. IEEE International Conference on Computer Vision nische und rechtliche Herausforderungen. Jubiläumsfeier des Workshop (ICCVW 2015), Chile, Santiago, 7.-13.12.2015 Instituts für Recht und Technik, Erlangen, 1991 – 2016, Kolloquium »Interdisziplinarität«, Universität Erlangen-Nürnberg, 20.-21.5.2016 Boldt, M.; Falge, R.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): Towards the Categorization of Changes at Stuttgart Airport. Beyerer, J.: 11th European Conference on Synthetic Aperture Radar (EUSAR 2016), Welche Information steckt in den Daten? Erfassung, Analyse, Hamburg, 6.-9.6.2016 Modellierung, Nutzung und Anwendungsbeispiele. 4. VDI Fach- konferenz Big Data Technologien in der Produktion, Ettlingen, 28.6.2016
146 Boldt, M.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): Carmer von, C.F.: An Iterative Approach to Optimize Change Classification in IR-Schiffsignaturmanagement. Lehrgangskurs SE2.14 »Radar-, VIS und SAR Time Series Data. SPIE Remote Sensing 2016, UK, Edinburgh, IR-Signaturen« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 30.11.2016 26.-29.9.2016 Denzer, R.; Sutschet, G.: Bretschneider, P.; Bernard, T.; Herzog, R.; Tippmann, V.; Warweg, O.; Systematische Betrachtung nicht-funktionaler Anforderungen Naumann, S.: beim Entwurf von I4.0 Service-Strukturen. Automation 2016, Mit dem Internet der Dinge vom Gebäude- zum Stadtteil-Energie- Baden-Baden, 7.-8.6.2016 management. VDE Kongress 2016, Mannheim, 7.-8.11.2016 Eberle, B.: Bulatov, D.; Häufel, G.; Pohl, M.: --Laser-Radar: Einfluss der Atmosphäre, operationelle Rand- Vectorization of road data extracted from aerial and UAV bedingungen und Potential des Laser-Radars. imagery. International Society for Photogrammetry and Remote --Augen- und Sensorschutz gegen Laser-Blendung und Laser- Sensing (ISPRS 2016), Tschechien, Prag, 12.-19.7.2016 Zerstörung. Lehrgang Lasertechnik, Bildungszentrum der Bundeswehr, Mannheim, Bulatov, D.; Wayand, I.; Schilling, H.: 22.4.2016 Automatic tree-crown detection in challenging scenarios. International Society for Photogrammetry and Remote Sensing Eberle, B.: (ISPRS 2016), Tschechien, Prag, 12.-19.7.2016 Grundlagen zum Seminarthema Lasergestützte Aufklärung mittels Laser-Radaren. Seminar FA 1.06 »Aufklärung mit moderner Bulatov, D.; Häufel G.; Pohl, M.: Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, Identification and correction of road courses by merging 31.5.-2.6.2016 successive segments and using improved attributes. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 Eberle, B.: Schutz vor zukünftigen Laserbedrohungen gegen Laser-Blendung Bulatov, D.; Schilling, H.: und Laser-Zerstörung. Wehrtechnisches F&T-Symposium »Safety Segmentation Methods for Detection of Stationary Vehicles in und Security in militärischen Waffensystemen«, Bildungszentrum der Combined Elevation and Optical Data. 23rd International Confe- Bundeswehr, Mannheim, 14.6.2016 rence on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Eberle, B.: Bulatov, D.; Kottler, B.; Rottensteiner, F. (Leibniz Universität Hannover): Laser-Radarsysteme für Zielaufklärung und Navigation. Seminar Energy Minimization of Discrete Functions with Higher-Order SE 2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« Potentials for Depth Maps Generation. 23rd International Confe- der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 16.6.2016 rence on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Eberle, B.: Bullinger, S.; Bodensteiner C.; Wuttke, S.; Arens, M.: Photothermal Effects of Nanoparticles in Liquid Media. Moving object reconstruction in monocular video data using 17th International Conference »Laser Optics 2016«, Russland, boundary generation. IEEE 23rd International Conference on St. Petersburg, 27.-30.6.2016 Pattern Recognition ICPR 2016, Mexiko, Cancun, 4.-8.12.2016 Eberle, B.: Burke, J.: Schutz vor zukünftigen Laserbedrohungen gegen Laser-Blendung Inspection of Reflective Surfaces with Deflectometry. und Laser-Zerstörung. Symposium »Cave Lucem«, Marinekommando International Conference on Processes in Combined Digital Optical Rostock, Rostock, 20.-21.9.2016 & Imaging Methods applied to Mechanical Engineering, Schweiz, Locarno, 12.5.2016 Eberle, B.: --Zukünftige passive Infrarot-Sensoren. Burke, J.: --Potenzial zukünftiger Laser-Sensoren. Das nimmermüde Auge – automatische Erkennung und Seminar SE 2.31 »Intelligente Sensorik II: Entwicklungspotential Klassifikation von Oberflächendefekten mit Deflektometrie. und zukünftige Systeme« der Carl-Cranz-Gesellschaft e.V., Fraunhofer Technologietag 2016, Deutschland, Fürth, 19.10.2016 Oberpfaffenhofen, 27.10.2016 van de Camp, F.; Gill, D.; Hild, J.; Beyerer, J.: Eberle, B.: An Analysis of Accuracy Requirements for Automatic Eyetracker Laser-Hinderniswarnung. Seminar SE 3.11 Recalibration at Runtime. HCI International 2016, Kanada, Toronto, »Warnsensorik (UV, IR, mmW)« der Carl-Cranz-Gesellschaft e.V., 17.-22.7.2016 Oberpfaffenhofen, 15.11.2016
147 LECTURES 2016 VORTRÄGE 2016
Ebert, R.: El Bekri, N.; Peinsipp-Byma, E.: Quantum Imaging - ein neues Verfahren für die bildhafte Auf- Assuring Data Quality by Placing the User in the Loop. klärung. DWT-Konferenz: Angewandte Forschung für Verteidigung International Symposium on Big Data and Data Science as part of und Sicherheit, Bonn, 23.-25.2.2016 The 2016 International Conference on Computational Science and Computational Intelligence, USA, Las Vegas, Nevada, 5.-17.12.2016 Ebert, R.: Laser Vibrometry for wind turbines inspections. SPIE Smart Essendorfer, B.: Structures and Materials + Nondestructive Evaluation and Health Informationsmanagement. Seminar FA1.07 »Daten- und Informati- Monitoring, USA, Las Vegas, Nevada, onsfusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016 20.-24.3.2016 Even, M.: Ebert, R.: A Study on Spatio-Temporal Filtering in the Spirit of SqueeSAR. Status of the work of the NATO JCGISR Team of Experts Electro- 11th European Conference on Synthetic Aperture Radar (EUSAR 2016), Optics on Reviewing STANAGS 4347, 4348, 4349, 4350, 4351. Hamburg, 6.-9.6.2016 NATO SET PBM, Italien, Pisa, 21.-23.10.2016 Even, M.: Van Eijk, A.; Piazzola, J.; Tedeschi. G.; Stein, K.: Accelerating Phase Unwrapping Based on Integer Linear Aerosol impacts on scene contrast, International IR target Programming by Processing of Subgraphs. 2016 IEEE International and background modeling & simulation workshop (ITBMS). Geoscience & Remote Sensing Symposium (IGARSS 2016), China, Frankreich, Carcassonne, 28-30.6.2016 Peking, 10.-15.7.2016
Van Eijk, A.; Davis, C.; Hammel, S.: Fay, A.; Drumm, O.; Eckhardt, R.; Gutermuth, G.; Krumsiek, D.; Laser Communication and Propagation through the Atmosphere Löwen, U.; Makait, T.; Mersch, T.; Schertl, A.; Schindler, T.; and Oceans V. SPIE San USA, San Diego, Kalifornien, 29-30.8.2016 Schleipen, M.; Schröck, S.: Durchgängigkeit in Wertschöpfungsketten von Industrie 4.0. Eisele, C.: Automation 2016, Baden-Baden, 7.-8.6.2016 FESTER: a propagation experiment, overview and first results. SPIE Remote Sensing, UK, Edinburgh, 26.-29.9.2016 Felsberg, M.; Kristian, M.; Matas, J.; Arens, M.; Krah, S.; Becker, S.; Hübner, W. et al.: Eisele, C.; Krieg, J.; Seiffer, D.: The thermal infrared visual object tracking VOT-TIR2016 Electro-optical muzzle flash detection. SPIE Defense and Security, challenge results. European Conference on Computer Vision UK, Edinburgh, 26.-29.9.2016 (ECCV), The Visual Object Tracking Challenge Workshop, Niederlande, Amsterdam, 8.-10. und 15.-16.10.2016 Eisele, C.: Arbeiten bei der Fraunhofer-Gesellschaft. Berufsvorbereitungs- Fischer, Y.; seminar der jDPG, Magnus-Haus Berlin, 2.-4.12.2016 Assistenzsysteme zur mulitsensoriellen maritimen Überwa- chung. Angewandte Forschung für Verteidigung und Sicherheit in El Bekri, N.; Syndikus, A.; Peinsipp-Byma, E.: Deutschland. Eine Veranstaltung der Studiengesellschaft DWT mbH Cluster Rule Based Algorithm for Detecting Incorrect Data in Zusammenarbeit mit dem BMVg, F&T-Ausschuss des BDSV, Records. UKSim-AMSS 18th International Conference on Modelling & Fraunhofer VVS und DLR, Bonn, 23.-25.2.2016 Simulation, Cambridge University, UK, Cambridge, 8.4.2016 Fischer, Y.; Hempel, D.: El Bekri, N.; Fischer, Y.; Marosz, D.: OnkoLeit: Ein medizinisches Expertensystem zum Therapie- A knowledge-based approach for task-oriented mission plan- monitoring von Krebserkrankungen. ITG Workshop Usability, ning. SPIE Conference on Defense and Commercial Sensing, USA, Bonn, 3.6.2016 Baltimore, Maryland, 17.-21.4.2016 Fischer, Y.; Anneken, M.: El Bekri, N.; Peinsipp-Byma, E.: High-Level Datenfusion. Seminar FA 1.07 »Daten- und Informations- Generic error identification in data sets. 25th International fusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 9.11.2016 Conference on Software Engineering and Data Engineering, USA, Denver, Colorado, 26.-28.9.2016 Flatt, H.: Industrielle Kommunikation im Wandel: Auswirkung von Industrie 4.0 auf IT-Sicherheitskonzepte. 4. VDI-Fachkonferenz Industrial IT Security 2016, Darmstadt, 29.6.2016
148 Flatt, H.: Gross, W.; Böhler J. (Universität Zürich); Industrie 4.0 konkret: Intelligente und flexible Forschungsfabrik Twizer, K. (Ben-Gurion-Universität); Kedem, B. (Ben-Gurion-Universität); SmartFactory OWL-Forschungsstand – Praktische Umsetzung – Lenz, A.; Kneubühler M. (Universität Zürich); Wellig, P. (armasuisse); Zukunftsaussichten. Security 2016-Vernetzte Sicherheit / Industrie 4.0, Oechslin, R. (armasuisse); Schilling, H.; Middelmann, W.: Essen, 28.9.2016 Determination of target detection limits in hyperspectral data using band selection and dimensionality reduction. Fullen, M.: SPIE 2016, UK, Edinburgh, 26.-29.9.2016 Project IMPROVE as a good practice example. Successful R&I between NRW and Poland, Köln, 20.9.2016 Guan, T.; Frey, C.: Unified predictive fuel efficiency optimization using traffic Geggus, S.: light sequence information. IEEE Intelligent Vehicles Symposium, Ansätze zur Lokalisierung einer Openstreetmap basierten Schweden, Göteborg, 19.-22.6.2016 Weltkarte. FOSGISS, Österreich, Salzburg, 3.-6.7.2016 Guan, T.; Frey, C.: Geggus, S.: Predictive energy efficiency optimization of an electric vehicle Towards a more readable Openstreetmap based world map for using information about traffic light sequences and other westerners. FOSS4G Conference, Bonn, 21.-28.8.2016 vehicles. 19th International Conference on Intelligent Transportation Systems, Brasilien, Rio de Janeiro, 1.-4.11.2016 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: A framework for voxel-based global scale modeling of urban Haas, C.: environments. ISPRS 3rd International GeoAdvances Workshop Herausforderungen für IT-Sicherheit und Industrie 4.0. Sitzung 2016, Türkei, Istanbul, 16.-17.10.2016 des Industrieausschusses der IHK Karlsruhe, IOSB Karlsruhe, 7.4.2016
Giessler, P.; Herzog, R.; Abeck, S.: Haas, C.: Entwicklung von ressourcenorientierten Services mithilfe des Design and Architecture of an Industrial IT Security Lab. API-Design-First-Prinzips. Karlsruher Entwicklertag, Karlsruhe, Tridentcom 2016, China, Hangzhoum, 14.-15.6.2016 14.6.2016 Haas, C.: Gladysz, S.: How to deal with IT Security issues in the industrial IoT - The Absolute and differential G-tilt in turbulence: theory and need and the architecture of a flexible Security Lab. Security of applications. SPIE Optics in Atmospheric Propagation and Adaptive Things World, Stream 4, Berlin, 27.6.2016 Systems XIX, UK, Edinburgh, 25.-30.9.2016 Haferkorn, D.: Gordon, M.; Hebel, M.; Arens, M.: An Organizational-Technical Concept to Deal with Open A descriptor and voting scheme for fast 3D self-localization in Source Software License Terms. World Multi-Conference on man-made environments. IEEE 13th Conference on Computer and Systemics, Cybernetics and Informatics (WMSCI 2016), Robot Vision CRV 2016, Kanada, Victoria B.C., 1.-3.6.2016 USA, Orlando, Florida, 5.-8.7.2016
Gordon, M.: Hammer, H.; Dubois, C.; Boldt, M.; Kuny, S.; Cadario, E.; Thiele, A.: Fast extraction of dominant planes in MLS-data of urban areas. Comparison of Multiple Methods for Detection Changes in 9th IAPR Workshop on Pattern recognition in Remote Sensing PRRS Urban Areas in TerraSAR-X Data. SPIE Remote Sensing 2016, UK, 2016, Mexiko, Cancun, 4.12.2016 Edinburgh, 26.-29.9.2016
Grasemann, G.: Hammer, J.-H.: Erfahrungen mit den automatisierten und harmonisierten Grenz- Eye Tracking, Gaze Analysis and Gaze-Based Interaction. übertrittskontrollsystem FastPass. VfS Kongress, Potsdam, 5.4.2016 Evaluating Use and Impact-Workshop of the Scottish Network on Digital Cultural Resources Evaluation, UK, Glasgow, 31.3.2016 Grasemann, G.; Kaufmann, M.; Peinsipp-Byma, E.: Automated border control with a harmonized modular reference Hammer, J.-H.; Voit, M.; Beyerer, J.: system – Experiences in the EU research project FASTPASS. Motion segmentation and appearance change detection based 11th Future Security; Berlin, 13.-14.9.2016 2D hand tracking. 19th International Conference on Information Fusion, Heidelberg, 5.-8.7.2016
149 LECTURES 2016 VORTRÄGE 2016
Hammer, J.-H.; Qu, C.; Voit, M.; Beyerer, J.: Hesse, N.; Stachowiak, G.; Breuer, T.; Arens, M.: 2D Hand Tracking with Motion Information, Skin Color Clas- Estimating body pose of infants in depth images using random sification and Aggregated Channel Features. 20th International ferns. IEEE International Conference on Computer Vision Workshop Conference on Image Processing, Computer Vision, & Pattern (ICCVW 2015), Chile, Santiago, 7.-13.12.2015 Recognition, USA, Las Vegas, Nevada, 25.-28.7.2016 Hesse, N.; Stachowiak, G.; Breuer, T.; Arens, M.: Hammer, M.; Hebel, M.; Arens, M.: Infant body pose estimation for motion analysis. Poster presented Automated object detection and tracking with a flash LiDAR at Human Motion Analysis for Healthcare Applications, UK, London, system. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 19.5.2016
Haraké, L.; Schilling, H.; Blohm, C. (OHB System AG); Hild, J.; Kühnle, C.; Beyerer, J.: Hillemann, M.; Lenz, A.; Becker, M.; Keskin, G.; Middelmann, W.: Gaze-based moving target acquisition in real-time full motion Concept for an Airborne Real-Time ISR System with Multi-Sensor video. ACM Symposium on Eye Tracking Research & Applications, 3D Data Acquisition. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 USA, Charleston, South Carolina, 14.-17.3.2016
Heizmann, M.; Puente León, F.; Sommer, K.-D.: Hild, J.; Petersen, P.; Beyerer, J.: Modellbildung in der Mess- und Automatisierungstechnik. VDI / Moving target acquisition by gaze pointing and button press VDE-GMA-Expertenforum »Modellbildung«, Karlsruhe, 2.-3.3.2016 using hand or foot. 2016 ACM Symposium on Eye Tracking Research & Applications, USA, Charleston, South Carolina, 14.-17.3.2016 Heizmann, M.; Kühnert, C.; Bernard, T.: Event-Detektion in Trinkwassernetzen mittels PCA und DPCA. Hild, J.; Krüger, W.; Peinsipp-Byma, E.; Beyerer, J.: VDI / VDE-GMA-Expertenforum »Modellbildung«, Karlsruhe, Interacting with target tracking algorithms in a gaze-enhanced 2.-3.3.2016 motion video analysis system. SPIE Conference on Geospatial Informatics, Fusion, and Motion Video Analytics, USA, Baltimore, Heizmann, M.: Maryland, 19.-21.4.2016 Thermische Deflektometrie zur Inspektion rauer Oberflächen. Optris Infrarot Tour, Ettlingen, 15.-16.3.2016 Hilbring, D.: Twitter Sentiment Analysis for German Football Matches. Heizmann, M.: Industry of Things World, Stream 2: Technology and Infrastructure, Roadmap Industrielle Bildverarbeitung – Marktanforderungen Berlin, 13.-14.9.2016 und Technologien von morgen. 61. Heidelberger Bildverarbeitungs- forum »Erfolge, Defizite und Zukunftsthemen der Bildverarbeitung«, Hilsenbeck, B.; Münch, D.; Kieritz, H.; Hübner, W.; Arens, M.: Festveranstaltung 20 Jahre Heidelberger Bildverarbeitungsforum, Hierarchical Hough forests for view-independent action recog- Heidelberg, 8.4.2016 nition. IEEE 23rd International Conference on Pattern Recognition ICPR 2016, Mexiko, Cancun, 4.-8.12.2016 Heizmann, M.: Roadmap Industrial Image Processing-Market Requirements Hilsenbeck, B.; Münch, D.; Grosselfinger, A.-K.; Hübner, W.; Arens, M.: and Technologies of Tomorrow. EMVA Business Conference 2016, Action recognition in the longwave infrared and the visible UK, Edinburgh, 9.-11.6.2016 spectrum using Hough forests. IEEE International Symposium on Multimedia ISM 2016, USA, San Jose, Kalifornien, 11.-13.12.2016 Heizmann, M.: Thermal Deflektometry. SIS.Europe 2016 - Surface Inspection Höfer, S.: Summit, Aachen, 28.-29.9.2016 Infrarot-Deflektometrie zur Inspektion diffus spiegelnder Oberflächen. Control Vision Talks 2016, Stuttgart, 28.4.2016 Heizmann, M.: Fusionsmethoden – eine Einführung. Seminar »Daten- und Illing, B.; Warweg, O.: Informationsfusion« der Carl-Cranz-Gesellschaft e. V., Karlsruhe, Achievable revenues for electric vehicles according to current 7.-10.11.2016 and future energy market conditions. EEM2016-IEEE European Energy Market, Portugal, Porto, 6.-9.6.2016 Heizmann, M.: --Texturanalyse. Jacoby, M.; Rauschenbach, T.: --Theorie und Methoden der 3D-Vermessung von Oberflächen. Fahrzeugführung von autonomen Unterwasserfahrzeugen Seminar »Inspektion und Charakterisierung von Oberflächen mit zur Pipelineinspektion. 50. Regelungstechnisches Kolloquium, Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 7.-8.12.2016 Boppard, 18.2.2016
150 Jacoby, M.; Riedel, T.: Kottler, B.; Bulatov, D.; Schilling, H.: Semantic Stream Processing in Dynamic Environments using Improving Semantic Orthophotos by a Fast Method Based on Dynamic Stream Selection. ML4CPS, Karlsruhe, 29.9.2016 Harmonic Inpainting. 23rd International Conference on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Jacoby, M.; Antonic, A.; Lapacz, R.; Pielorz, J.; Kreiner, K.: Semantic Interoperability as Key to IoT Platform Federation. IoT Krempel, E.; Birnstill, P.; Beyerer, J.: Conference 2016, 2nd International Workshop on Interoperability & Working and living in interactive environments requirements Open Source Solutions for the Internet of Things, Stuttgart, 7.-9.11.2016 for security and privacy. 11th Future Security, Berlin, 13.-14.9.2016
Jamboti, K.: Kristan, M.; Leonardis, A.; Matas, J.; Becker, S.; Krah, S.; Hübner, W.; Visualization to support identification, exploitation, and fusion Arens, M. et al.: of data and information delivered from heterogeneous sources The visual object tracking VOT2016 challenge results. European in ISR. SPIE Defense + Commercial Sensing 2016, USA, Baltimore, Conference on Computer Vision (ECCV), The Visual Object Tracking Maryland, 19.-21.4.2016 Challenge Workshop, Niederlande, Amsterdam, 8.-10. und 15.-16.10.2016 Jasperneite, J.; Niggemann, O.: Wie intelligent werden Maschinen? Vortrag anlässlich des Kuny, S.: 50-jährigen Bestehens der Lemgoer Elektrotechnik, Lemgo, 2.11.2016 Sensordatenfusion für interaktive Luft- und Satelliten- bildauswertung. Seminar SE 2.18 Multisensordatenfusion: Jasperneite, J.: Grundlagen und Anwendungen der Carl-Cranz-Gesellschaft e.V., Digital in NRW: Wie kommt Industrie 4.0 in den Mittelstand? Wachtberg-Werthhoven, 19.-21.4.2016 Schlossrunde der Gesellschaft für Wirtschaftsförderung im Kreis Höxter mbH, der Industrie- und Handelskammer Ostwestfalen zu Kuny, S.; Hammer, H.; Schulz, K.: Bielefeld, und der Hochschule OWL, Abtei Marienmünster, 23.11.2016 Towards a Reliable Detection of Debris in High Resolution SAR Images of Urban Areas. 11th European Conference on Synthetic Käßler, M.: Aperture Radar (EUSAR 2016), Hamburg, 6.-9.6.2016 Energieforschung am Fraunhofer IOSB-AST. Bürger Energie-Treff Bürgerenergie Jena, Jena, 28.1.2016 Kuny, S.; Hammer, H.; Schulz, K.: Assessing the Suitability of simulated SAR Signatures of Debris Kaufmann, I.: for the Usage in Damage Detection. International Society for Laser-Doppler-Vibrometrie in der IED- und Minen-Aufklärung. Photogrammetry and Remote Sensing (ISPRS 2016), Tschechien, 7. Nationale Counter-IED Konferenz 2016, Bildungszentrum der Prag, 12.-19.7.2016 Bundeswehr, Mannheim, 28.9.2016 Kuwertz, A.: Keßler, S.: Using heterogeneous multilevel swarms of UAVs and high-level Performance Assessment of Electro-Optical Systems with data fusion to support situation management in surveillance TRM4v2 – Status and Future. 11th International ITBM&S Workshop scenarios. 2016 IEEE International Conference on Multisensor Fusion (IR Target and Background, Modeling and Simulation), Frankreich, and Integration for Intelligent Systems, Baden-Baden, 19.-21.9.2016 Carcassonne, 27.6.2016 Kuwertz, A.: Keßler, S.; Wittenstein, W.: Vorgehen und Werkzeuge für die angewandte Informations- Reichweitenmodell für Wärmebildgeräte TRM4. Seminar SE 1.02 fusion. Seminar, FA1.07 »Daten- und Informationsfusion« der Carl- »Infrarottechnik–Grundlagen, Trends und moderne Anwendungen« Cranz-Gesellschaft e.V., Fraunhofer IOSB, Karlsruhe, 7.-10.11.2016 der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016 Längle, T.: Kieritz, H.; Becker, S.; Hübner, W.; Arens, M.: Optical Computing zur materialselektiven Sortierung Online multi-person tracking using integral channel features. feinkörnigen Bauschutts. Fachtagung Recycling R’16, Weimar, 13th IEEE International Conference on Advanced Video and Signal 19.-20.9.2016 Based Surveillance AVSS 2016, USA, Colorado Springs, Colorado, 23.-26.8.2016 Längle, T.: Introduction to Data Fusion in Sensor-Based Sorting. 2016 IEEE Klarner, T.; Arnoldt, A.; Warweg, O.: International Conference on Multisensor Fusion and Integration Intraday Charging Restrictions for Electric Vehicles with for Intelligent Systems (MFI 2016); Special Session: Data Fusion in Consideration to Grid Capacities. IEEE EnergyCon 2016, Belgien, Sensor-based Sorting, Baden-Baden, 21.9.2016 Leuven, 4.-8.4.2016
151 LECTURES 2016 VORTRÄGE 2016
Le, T.-T.; Ziebarth, M.; Greiner, T.; Heizmann, H.; Maier, G.: Systematic design of object shape matched wavelet filter banks High-throughput sensor-based sorting via approximate for defect detection. International Conference on Telecommunications computing. Forum Bildverarbeitung 2016, Karlsruhe, 1.12.2016 and Signal Processing 2016, Österreich, Wien, 27.6.2016 Martin, M.; Diederichs, F.; Li, K.; Voit, M.; Melcher, V.; Widlroither, H.; Lenz, A.; Keskin, G.; Schilling, H.; Groß, W.; Middelmann, W.: Stiefelhagen, R.: Ship classification in terrestrial hyperspectral data. Klassifikation von Fahrerzuständen und Nebentätigkeiten über SPIE 2016, UK, Edinburgh, 26.-29.9.2016 / Vortrag: A. Lenz Körperposen bei automatisierter Fahrt. VDI / VW Gemeinschafts- tagung Fahrerassistenzsysteme und automatisiertes Fahren, Li, Q.; Müller, F.; Wenzel, A.; Rauschenbach, T.: Wolfsburg, 8.-9.11.2016 Simulation-based comparison of 2D Scan Matching algorithms for different rangefinders. 21st International Conference on Meidow, J.; Hammer, H.; Pohl, M.; Bulatov, D.: Methods and Models in Automation and Robotics (MMAR), Polen, Enhancement of Generic Building Models by Recognition and Miedzyzdroje, 29.8.-1.9.2016 Enforcement of Geometric Constraints. ISPRS Congress 2016, Tschechien, Prag, 12.-19.7.2016 Luo, D.: Optical unmixing using programmable spectral source based Meier, D.: on DMD. SPIE 9855, Next-Generation Spectroscopic Technologies IX, Herausforderungen bei der Sicherheitsanalyse von industriellen USA, Baltimore, Maryland, 12.5.2016 Systemen. CAST Workshop »Mobile und Embedded Security«, Darmstadt, 2.6.2016 Luo, D.: Compressive shape from focus based on a linear measurement Meyer, J.: model. Forum Bildverarbeitung 2016, Karlsruhe, 2.12.2016 Simulation of an Inverse Schlieren Image Acquisition System for Inspecting Transparent Objects. IS&T International Symposium Lutzmann, P.: on Electronic Imaging 2016, USA, San Francisco, Kalifornien, 17.2.2016 --Gated-Viewing Systeme. --Laser Vibrometrie. Meyer, J.: Seminar SE 1.04 »Neue Lasersensoren für den militärischen und About the Acquisition and Processing of Ray Deflection sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Histograms for Transparent Object Inspection. 18th Irish Machine Oberpfaffenhofen, 13.4.2016 Vision & Image Processing Conference Proceedings 2016; Irland, Galway, 25.8.2016 Lutzmann, P.; Göhler, B.; Scherer-Klöckling, C.; Scherer-Negenborn, N.; Brunner, S.; van Putten, F.; Hill, C.A.: Meyer, J.: Laser Doppler vibrometry on rotating wind turbine blades. Acquiring and Processing Light Deflection Maps for Transparent 18th Coherent Laser radar Conference CLRC 2016, USA, Boulder, Object Inspection. 2nd International Conference on Frontiers of Colorado, 27.6.-1.7.2016 Signal Processing (ICFSP 2016), Polen, Warschau, 16.10.2016
Lutzmann, P.: Meyer, J.: Laser doppler vibrometry on rotating wind turbine blades. Light transport matrix acquisition and processing for transparent 18th Coherent Laser Radar Conference, CLRC 2016, USA, Boulder, object inspection. Forum Bildverarbeitung 2016, Karlsruhe, 1.12.2016 Colorado, 30.6.2016 Michaelsen, E.; Münch, D.; Arens, M.: Lutzmann, P.: Searching remotely sensed images for meaningful nested Militärisches und ziviles Potenzial des Laserradars. gestalten. XXIII ISPRS Congress 2016, Tschechien, Prag, 12.-19.7.2016 Seminar SE 1.02 »Infrarottechnik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016 Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Dachsbacher, C.; Wörn, H.: Maier, G.: Performance Characterization in Automated Optical Inspection Fast Multitarget Tracking Via Strategy Switching for Sensor- using CAD Models and Graphical Simulations. AHMT 2016, Based Sorting. 2016 IEEE International Conference on Multisensor Deutschland, Hannover, 16.9.2016 Fusion and Integration for Intelligent Systems (MFI 2016); Special Session: Data Fusion in Sensor-based Sorting, Baden-Baden, Münch, D.; Becker, S.; Kieritz, H.; Hübner, W.; Arens, M.: 21.9.2016 Video-based log generation for security systems in indoor surveillance scenarios. 11th Future Security, Berlin, 13.-14.9.2016
152 Münch, D.; Hilsenbeck, B.; Kieritz, H.; Becker, S.; Grosselfinger, A.-K.; Richter, M.: Hübner, W.; Arens, M.: Feature Selection with a Budget. 2nd World Congress on Electrical Detection of infrastructure manipulation with knowledge-based Engineering and Computer Systems and Science (EECSS’16), Ungarn, video surveillance. SPIE Security + Defence 2016, UK, Edinburgh, Budapest, 16.8.2016 26.-29.9.2016 Richter, M.: Negara, C.: Combining synthetic image acquisition and machine learning: Retroreflective Laser Scanner System for Inline Ellipsometric accelerated design and deployment of sorting systems. Forum Measurements at Curved Surfaces. 7th International Conference Bildverarbeitung 2016, Karlsruhe, 1.12.2016 on Spectroscopic Ellipsometry (ICSE-7), Berlin, 6.6.2016 Richter, M.: Nguyen, L.; Karimanzira, D.; Rauschenbach, T.; Ribbe, L.: Knowing when you don't: Bag of visual words with reject option A procedure for approximating a complex hydrodynamic for automatic visual inspection of bulk materials. 23rd International model by the adaptive time delay method. World Environmental Conference on Pattern Recognition (ICPR 2016), Mexiko, Cancun, and Water Resources Congress, USA, West Palm Beach, Florida, 6.12.2016 22.-26.5.2016 Ritter, S.: Pak, A.: Potentiale der Querverbundoptimierung im Kontext neuer The concept and implementation of smooth generic camera Technologien. Thüga-Forum: Thermische Energiespeicher, calibration. SPIE Optical Engineering + Applications, USA, San Würzburg, 8.6.2016 Diego, Kalifornien, 28.8.2016 Roller, W.: Peinsipp-Byma, E.: Auswertung von SAR-Bilddaten. Seminar SE 3.27 »Miniaturisierte Befehlsstelle der Zukunft. Fachveranstaltung »Neue Technologien für Sensorik für den UAV-Einsatz« der Carl-Cranz-Gesellschaft e.V., die Terrorabwehr der FhG« am Fraunhofer IOSB, Karlsruhe, 8.3.2016 Oberpfaffenhofen, 2.6.2016
Peinsipp-Byma, E.: Roller, W.: Rechnergestützte Satelliten- und Luftbildauswertung. Synthetisches Apertur Radar-Grundlagen. Fachtechnische Grund- Seminar FA 1.05 »Aufklärung mit moderner Sensorik« der lagen - Informationstechnik und Elektronik, BiZBw, Mannheim, 3.6.2016 Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 31.5.2016 Roller, W.; Streicher, A.: Peinsipp-Byma, E.: Adaptive Wissensvermittlung für Serious Games und Simulatio- Erkennungsunterstützung. Seminar FA 1.15 »Luft- und raum- nen. Ausbildungskongress der Bundeswehr, Hamburg, 13.-15.9.2016 gestützte Bildaufklärung« der Carl-Cranz-Gesellschaft e.V., Fraunhofer IOSB Karlsruhe, 13.-16.6.2016 Rublack, L.; Warweg, O.; Bretschneider, P.; Freund, S.; Bieber, M.: Sensitivity Analysis of Adiabatic Compressed Air Energy Storage. Pfrommer, J.: IEEE PES Innovative Smart Grid Technologies, Slowenien, Ljubljane, Semantic Interoperability at Big-Data Scale for the Industrial 10.-12.10.2016 Internet of Things with the open62541 OPC UA Implementation. IOT Conference 2016, 2nd International Workshop on Interoperability Sander, J.: & Open Source Solutions for the Internet of Things, Stuttgart, A computer-aided assistance system for ressource-optimal sensor 7.-9.11.2016 scheduling in Intelligence, Surveillance, and Reconnaissance. 2016 IEEE International Conference on Multisensor Fusion and Philipp, P.; Schreiter, L.; Giehl, J.; Fischer, Y.; Raczkowsky, J.; Integration for Intelligent Systems, Baden-Baden, 19.-21.9.2016 Schwarz, M.; Wörn, H.; Beyerer, J.: Situation Detection for an Interactive Assistance in Surgical Sander, J.: Interventions Based on Dynamic Bayesian Networks. 6th Joint Ansätze zur lokalen Bayes'schen Informationsfusion. Workshop on New Technologies for Computer / Robot Assisted Seminar FA1.07 »Daten- und Informationsfusion« der Surgery, Italien, Pisa, 12.-14.9.2016 Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016
Richter, M.: Sander, J.: Bag of visual words-A computer vision method applied to bulk Assistenzsysteme, Informationsfusion und Signaturdatenbanken. material sorting. 7th Sensor-Based Sorting & Control 2016, Aachen, Seminar, FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« der 24.2.2016 Carl-Cranz Gesellschaft e.V., Fraunhofer IOSB, Karlsruhe, 22.-23.11.2016
153 LECTURES 2016 VORTRÄGE 2016
Santamaria, E.; Moßgraber, J.; Deuerlein, J.; Kühnert, C.; Bernard, T.: Schneider, M.; Walther, C.; Wenzel, A.: An integrated system for enhanced response management in Classification of Production Quality in Injection Moulding CBRN related contamination events of drinking water. 14th inter- with an Embedded Diagnostic System Using a Fuzzy Inference national CCWI Conference, Niederlande, Amsterdam, 7.-9.11.2016 System. 26th Workshop on Computational Intelligence, Dortmund, 24.-25.11.2016 Schleipen, M.: Harmonisierung von Automation ML und OPC UA – Zwei Schulz, K.: Standards für Industrie 4.0, eine Lösung für den Anwender. GIS und Sensordatenfusion. Seminar FA 1.07 »Daten- und Informati- VDI Konferenz Industrie 4.0, Düsseldorf, 27.-28.1.2016 onsfusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016
Schleipen, M.: Schwarz, A.: PLUGandWORK auf Basis der offenen internationalen Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE2.28 Standards Automation ML und OPC UA. Forum Industrie 4.0, »Intelligente Sensorik I: Grundlagen und Anwendungen« der Hannover, 27.4.2016 Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 16.6.2016
Schleipen, M.; Röhrig, B.; Tröger, K.; Löfters, C.: Schwarz, A.: Industrie 4.0 – wie wird Visual Computing die Fertigungs- Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE1.02 landschaft revolutionieren? 8. MES-Tagung-MES in der Praxis, »Infrarottechnik-Grundlagen, Trends und moderne Anwendungen« Hannover, 28.4.2016 der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016
Schleipen, M.; Gilani, S.; Bischoff, T.; Pfrommer, J.: Schwarz, A.: OPC UA & Industrie 4.0-enabling technology with high diversity Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs and variability. CIRP-CMS 2016, Stuttgart, 26.5.2016 SE2.14 »Radar-, VIS- und IR Signaturen: Technik und Anwendung« der Carl-Cranz-Gesellschaft e.V., 29.11.2016 Schleipen, M.: PLUGandWORK basierend auf offenen Standards. Fachforum Schweitzer, C.: Industrie 4.0, Technologie Centrum Westbayern, Nördlingen, Assessment of Space-Based Early Warning Systems for TBM 31.5.2016 Detection. NATO Space Symposium, UK, Universität Loughborough, 17.-19.5.2016 Schleipen, M.; Pfrommer, J.: OPC UA als Basistechnologie zur Orchestrierung von Produkti- Seyboldt, R.; Frese, C.; Zube, A.: onssystemen. Automation 2016, Baden-Baden, 8.6.2016 Sampling-based Path Planning to Cartesian Goal Positions for a Mobile Manipulator Exploiting Kinematic Redundancy. Schleipen, M.: 47th International Symposium on Robotics (ISR), München, 21.6.2016 Combining Automation ML and OPC UA. OPC Day, Finnland, Hyvinkää, 18.10.2016 Sidorenko, J.; Scherer-Negenborn, N.; Arens, M.; Michaelsen, E.: Multilateration of the local position measurement. IEEE Interna- Schleipen, M.: tional Conference on Indoor Positioning and Indoor Navigation IPIN, AutomationML and OPC UA – enabling technologies for Spanien, Madrid, 4.-7.10.2016 PLUGandWORK in a smart production. 4th AML User Conference, Esslingen, 18.-19.10.2016 Stephan, T.; Dürrwang, J.; Burke, J.; Werling, S.; Beyerer, J: Extended Photometric Stereo Model. Forum Bildverarbeitung, Schmieder, M.; Moßgraber, J.: Deutschland, Karlsruhe, 2.12.2016 Komplexe Auswertung von Fachinformationen am Beispiel der Fachanwendung Grundwasser Baden-Württemberg. Streicher, A.: 23. Workshop Arbeitsreis Umweltinformationssysteme-UIS 2016 Das Technologieakzeptanzmodell für kartenbasierte Lernspiele »Umweltbeobachtung nah und fern«, Leipzig, 2.6.2016 in der Bildauswertung. DeLFI 2016-Die 14. E-Learning Fachtagung Informatik der Gesellschaft für Informatik e.V., Postdam, 11.-14.9.2016 Schneider, D.: Industry 4.0: From data acquisition to the cloud in the context Streicher, A.: of IT Security. Cyber Security for Industrial Control Systems, Game-Based Training for Complex Multi-institutional Exercises 3. CYBICS, Bochum, 24.2.2016 of Joint Forces. Adaptive and Adaptable Learning: 11th European Conference on Technology Enhanced Learning, EC-TEL 2016, Frankreich, Lyon, 13.-16.9.2016
154 Tchouchenkov, I.; Schönbein, R.: Usländer, T.: Eigenschaften, Detektions- und Abwehrmöglichkeiten von Visionen-Industrie 4.0-wo stehen wir in 5 Jahren? Industrie 4.0 kleinen UAS. 1. Counter-UAS Kolloquium, Karlsruhe, 16.3.2016 »Smart Factory Smart People«, Italien, Mailand, 19.10.2016
Tchouchenkov, I.: Usländer, T.: --Eigenschaften und Technik von Kleindrohnen. Industrie 4.0 Standardisierung-Übersicht und aktueller Stand. --Einsatzmöglichkeiten, Gefahren, Rechtslage. Technikforum Industrie 4.0 - Chance und Herausforderungen für den --Bekämpfungsmöglichkeiten. Mittelstand, Nördlingen, 15.11.2016 --Stand der Technik – Kontroll- und Abwehrsysteme. Seminar FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« Usländer, T.: der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 22.-23.11.2016 IoT Standardization for Factory Automation-Insights into the Industrie 4.0 Approach. IoT World Europe, Irland, Dublin, 22.11.2016 Thiele, A.; Dubois, C. (KIT); Boldt, M.; Hinz, S. (KIT): Using TanDEM Data for Forest Height Estimation and Change Wagner, B.; Eck, R.; Unmuessig, G.; Peinsipp-Byma, E.: Detection. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 Interactive analysis of geodata based intelligence. SPIE Conference on Sensors, and Command, Control, Communications, and Intelligence, Thomalla, C.: USA, Baltimore, Maryland, 18.-19.7.2016 Predicticve Analytics im Kontext IT Security und Industrie 4.0. Sitzung des Industrieausschusses der IHK Karlsruhe, IOSB Karlsruhe, Wagner, P.; Birnstill, P.; Krempel, E.; Bretthauer, S.; Beyerer, J.: 3.5.2016 Privacy-Dashcam-Datenschutzfreundliche Dashcams durch Erzwingen externer Anonymisierung. Informatik 2016, Öster- Thomé, S.; Michaelsen, E.; Scherer-Negenborn, N.; Jäger, K.; reich, Klagenfurt, 26.-30.9.2016 Doktorski, L.: Fusion of trackers on thermal image sequences. IEEE 18th Warweg, O.: International Conference on Information Fusion FUSION, USA, From Energy Efficient Buildings to Energy Efficient Districts, Washington D.C., 6.-9.7.2015 Challenges for the Energy Management. Smart Energy Cities Conference at BIXPO, Südkorea, Gwangju, 3.11.2016 Usländer, T.: Agile Service Engineering for the Industrial Internet of Things. Watson, K.: Bitkom Innovation Forum, HMI, Hannover, 26.4.2016 IIC Testbed-Smart Factory Web. Testbed Working Group Meeting des IIC Consortium Quarterly Meeting, St.-Leon-Rot, 20.9.2016 Usländer, T.: Agile Service-oriented Analysis and Design of Industrial Internet Watson, K.: Applications. CIRP-CMS 2016, Stuttgart, 25.-27.5.2016 Creating a Smart Factory Web Based upon AutomationML. 4th AML User Conference, Esslingen, 18.-19.10.2016 Usländer, T.: Agiles Service-Engineering für Industrie 4.0. Automation 2016, Wuttke, S.; Middelmann, W.; Stilla, U. (TU München): Baden-Baden, 7.-8.6.2016 Active Learning with SVM for Land Cover Classification-What Can Go Wrong? i-KNOW 2016-Workshop on Active Learning, Usländer, T.: Österreich, Graz, 17.-19.10.2016 Redesigning industries and enterprises in world of connected objects. Power Meeting, IoT Summit, Italien, Mailand, 16.6.2016 Zaschke, C.: Interoperability of heterogeneous distributed systems. SPIE Usländer, T.: Defense + Commercial Sensing 2016, USA, Baltimore, Maryland, Internet der Dinge-Technologie, Geschäftsmodelle und Stan- 17.-21.4.2016 dardisierung (Industrie 4.0). Klausurtagung der IT-Ressortleiter des Innenministeriums, Rastatt, 23.6.2016 Zimmermann, T.; Klaiber, S.; Bretschneider, P.: A Market System Operator as a new role to balance the Usländer, T.: distribution grid and to coordinate market and grid operations. Risks of Industrie 4.0-An Information Technology Perspective. IEEE EnergyCon 2016, Belgien, Leuven, 4.-8.4.2016 IDRV Schweiz, Davos, 28.8.-1.9.2016 Zube, A.; Hofmann, J.; Frese, C.: Usländer, T.: Model Predictive Contact Control for Human-Robot Interaction. Engineering IIoT systems in an agile manner. Industry of Things 47th International Symposium on Robotics (ISR), München, 22.6.2016 World, Stream 2: Technology and Infrastructure, Berlin, 19.-20.9.2016
155 LECTURES 2017 VORTRÄGE 2017
Abel, P.; Kieritz, H.; Becker, S.; Arens, M.: Beyerer, J.: Robust Visual Object Tracking with Interleaved Segmentation. Beitrag zur Formulierung einer »Systemtheorie Sicherheit« SPIE Security + Defence 2017, Polen, Warschau, 11.-14.9.2017 Soziotechnischer Systeme. KASTEL, Karlsruhe, 28.2.2017
Adomeit, U.; Krieg, J.: Beyerer, J.: Investigating Nightglow Illumination for Night Vision Applica- Ausgewählte Beispiele zur KI-Forschung am IOSB. Digital Hub, tions. 43. Freiburger Infrarotkolloquium, Freiburg, 14.3.2017 Karlsruhe, 6.3.2017
Albrecht, A.: Beyerer, J.: Application of an off-the-shelf Fiber Optic Gyroscope based IT-Sicherheitsforschung bei Fraunhofer –Theorie, Technologien, Inertial Measurement Unit for Attitude and Heading Estimation. Labore und Fortbildung. Lernlaboreröffnung Lemgo, Lemgo, IEEE SENSORS 2017, UK, Glasgow, 29.10.-1.11.2017 16.3.2017
Anneken, M.; Fischer, Y.; Beyerer, J.: Beyerer, J.: A multi-agent approach to model and analyze the behavior Fit für die Zukunft? Perspektiven der Verteidigungsforschung in of vessels in the maritime domain. International Conference on Deutschland. Kooperationsveranstaltung der Fraunhofer-Gesellschaft Agents and Artificial Intelligence 2017, Portugal, Porto, 24.-26.2.2017 und der Deutschen Gesellschaft für Wehrtechnik mbH, Gesellschaft für Sicherheitspolitik e.V., Berlin, 23.3.2017 Anstett, G.: Neue Sensorkonzepte: THz-Technologie und -Sensoren. Seminar Beyerer, J.: SE 1.04 »Neue Lasersensoren für den militärischen und sicherheits- Videoüberwachung für die Sicherheit - Funktionen, Systeme relevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, und Herausforderungen. Behördentag IOSB, Fraunhofer IOSB, 10.5.2017 Karlsruhe, 8.5.2017
Bapp, F.; Becker, J.; Beyerer, J.; Doll, J.; Filsinger, M.; Frese, Ch.; Beyerer, J.: Hubschneider, Ch.; Lauber, A.; Müller-Quade (KIT), J.; Pauli, M.; Fraunhofer-Verbund Verteidigungs- und Sicherheitsforschung Roschani, M.; Salscheider, O.; Rosenhahn, B.; Ruf, M.; Stiller, Ch.; VVS – Aktivitäten der diversen Institute. F&T-Symposium Counter Willersinn, D.; Ziehn, J.R.: UAS – Neue Wege in der Drohnenbekämpfung, Bildungszentrum der A Non-Invasive Cyberrisk in Cooperative Driving. 8. Tagung Bundeswehr, Mannheim, 27.-28.6.2017 Fahrerassistenz: Einführung hochautomatisiertes Fahren, München, 22.-23.11.2017 Beyerer, J.: Intelligente Autonome Systeme - Eine Tour d‘horizon aus Sicht Becker, M.; Runkel, I. (Fa. GEOSYSTEMS); Espinosa, N.; Middelmann, W.: der Forschung. Unmanned Vehicles VI, Studiengesellschaft der 3D Building Reconstruction in a remote sensing application Deutschen Gesellschaft für Wehrtechnik mbH, Bonn Bad Godesberg, workflow. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 4.7.2017
Beyerer, J.: Beyerer, J.: IT-Sicherheitsforschung bei Fraunhofer – Theorie, Technologien, Quantifizierung von Risiko. Sommerseminar, Griesget-Hof, 1.8.2017 Labore und Fortbildung. Eröffnung des gemeinsamen Lernlabors Cybersicherheit der Hochschule Zittau / Görlitz und des Fraunhofer Beyerer, J.: IOSB – Institutsteil Angewandte Systemtechnik, Maschinelles Lernen und Künstliche Intelligenz verändern die Hochschule Zittau / Görlitz, Görlitz, 11.1.2017 Industrielle Automatisierung. Kolloquium: Netze und Brücken, Fraunhofer IOSB, 13.9.2017 Beyerer, J.: Kritische Infrastrukturen – Risiken, Schutz und Resilienz. Inno- Beyerer, J.: vation mit Tradition – Metzler meets Fraunhofer, Business-Lunch zum Blick in die Fraunhofer-Labore. Fraunhofer-Tag der Künstlichen Thema »Schutz und Sicherheit – widerstandsfähige Infrastrukturen«, Intelligenz, »MIT KOGNITIVEN SYSTEMEN, LERNENDEN MASCHINEN Bankhaus Metzler, Frankfurt, 2.2.2017 UND DIGITALEN ASSISTENTEN DIE ZUKUNFT GESTALTEN«, Fraunhofer-Forum Berlin, 29.11.2017 Beyerer, J.: Sicherheit und Resilienz. Fraunhofer Morgen-Radar: Blume, M.; Flatt, H.: »Sicherheit und Resilienz«, Berlin, 15.2.2017 Intelligente Inbetriebnahme von Maschinen und verketteten Anlagen-SecurePLUGandWORK. Wissenschafts-und Industrieforum Intelligente Technische Systeme, Paderborn, 11.5.2017
156 Boldt, M.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): Eberle, B.: Change Classification in SAR Time Series: A Functional Approach. --Einführung in das Thema Laser-Radar. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 --Operationelle Grundlagen für Lasersensoren. --Laserradar: Verfahren und Systeme. Borgmann, B.; Hebel, M.; Arens, M.; Stilla, U.: --Fernerkennung von Bedrohungen und Gefahren. Konzept zur Gefährdungserkennung im städtischen Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicher- Verkehrsraum durch Personendetektion in MLS-Punktwolken. heitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 37. Wissenschaftlich-Technische Jahrestagung der DGPF 2017, 9.-11.5.2017 Würzburg, 8.-10.3.2017 Ebert, R.: Borgmann, B.; Hebel, M.; Arens, M.; Stilla, U.: Technical Watch on Nigh Vision Sensor Image Fusion Vision Detection of persons in MLS point clouds using Implicit Sensor Image Fusion. NATO SET PBM, Finnland, Helsinki, Shape Models. The ISPRS Geospatial Week 2017, China, Wuhan, 21.-23.5.2017 18.-22.9.2017 Eberle, B.: Brink, G.; Mulay, G.: --Grundlagen zum Seminarthema. Fast Leaps and Deep Dives towards Autonomous, Fast, and --Lasergestützte Aufklärung mittels Laser-Radaren High-Resolution Deep-Sea Ocean Exploration. 16th Conference on Seminar FA 1.06 »Aufklärung mit moderner Sensorik« der Computer and IT Applications in the Maritime Industries (COMPIT’17), Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 30.5.-1.6.2017 UK, Cardiff, 15.-17.5.2017 Eberle, B.: Brink, G.: Laser-Radarsysteme für Zielaufklärung und Navigation. Seminar Active Contributions from the AUV during the Recovery SE 2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« Process: our novel c-LARS Launch and Recovery System. der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 22.6.2017 2. LARSFORUM on launch and recovery, UK, London, 7.-8.6.2017 Eck, R.; Wagner, B.: Bulatov, D.; Wenzel, S. (Institut für Geodäsie und Geoinformation, Interaktive Visualisierung von OGC-standardisierten Geodaten. Universität Bonn); Häufel, G.; Meidow, J.: Workshop des Bundesamtes für Kartographie und Geodäsie Chain-wise Generalization of Road Networks using Model »Gewußt wo!«, Frankfurt, 22.2.2017 Selection. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover-Workshop), Hannover, 6.-9.6.2017 Eck, R.: Interaktive Visualisierung geodatenbasierter Lagedaten. Burke, J.; Zhong, L.: Innovationsworkshop »Einsatzzentrale & Einsatz- / Lageführung der Unterdrückung von Kontrast-Artefakten bei der Phasenmessung. Zukunft« der Kantonspolizei, Schweiz, Zürich, 31.3.2017 Jahrestagung DGaO, Deutschland, Dresden, 7.6.2017 Eisele, C.; Sucher, E.; Wendelstein, N.; Stein, K.: Burke, J.; Zhong, L.: Electro-optical propagation measurements during Suppression of contrast-related artefacts in phase-measuring the MINOTAUROS experiment in the Cretan Sea. structured light techniques. SPIE Optical Measurement Systems for SPIE Remote Sensing, Polen, Warschau, 10.–15.9.2017 Industrial Inspection X, Deutschland, München, 27.6.2017 Emter, T.: Doktorski, L.: Algorithmen-Toolbox für autonome mobile Roboter. DWT- An Application of Limiting Interpolation to the Fourier Series Tagung »Unmanned Vehicles VI«, Bonn Bad Godesberg, 4.-5.7.2017 Theory. 28th International Workshop on Operator Theory and its Applications IWOTA 2017, Chemnitz, 14.-18.8.2017 Frese, C.: Kooperatives Fahren – Benefits und Methoden. Ebert, R.: Industriearbeitskreis »Vernetzte Mobilität« der »Profilregion New Research Activities at Fraunhofer IOSB. ONERA / DOTA, Mobilitätssysteme Karlsruhe«, Thema »Resilientes kooperatives Frankreich, Palaiseau, 7.3.2017 Fahren im Mischverkehr«, Karlsruhe, 19.5.2017
Eberle, B.: Fullen, M.: Nonlinear Optical Effects in Colloidal Carbon Nano-Horns. Project IMPROVE as a good practice example. HMI 2017, ISL Scientific Symposium 2017 on Protection Technologies, North Rhine-Westphalia-Poland: two strong partners in science ISL Saint-Louis, Frankreich, Saint-Louis, 14.3.2017 and business, Hannover, 26.4.2017
157 LECTURES 2017 VORTRÄGE 2017
Fullen, M.: Gruna, R.: Defining and Validating Similarity Measures for Industrial Optische Sortierung von Bauschutt-Herausforderungen und Alarm Flood Analysis. IEEE 15th International Conference on Lösungsansätze. Workshop UMSICHT: Zur Sache!, Oberhausen, Industrial Informatics INDIN‘2017, Emden, 26.7.2017 26.1.2017
Fullen, M.: Gruna, R.: Semi-supervised Case-based Approach to Alarm Flood Analysis. Comparability of spectroscopic measurements from different 3. Fachkonferenz Maschinelles Lernen in der Produktion institutes and sensors; Evaluation based on different food (ML4CPS 2017), Lemgo, 26.10.2017 samples. OCM-SpectroNet Collaboration Conference 2017, Karlsruhe, 21.3.2017 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: Filtern bewegter Objekte aus mobilen LiDAR-Daten auf Grund- Gruna, R.: lage volumetrischer Modelle. 37. Wissenschaftlich-Technische Farbmessung. Fraunhofer VISION-Seminar mit Praktikum: Inspektion Jahrestagung der DGPF 2017, Würzburg, 8.-10.3.2017 und Charakterisierung von Oberflächen mit Bildverarbeitung, Karlsruhe, 5.12.2017 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: An approach to extract moving objects from MLS data using Guan, T.; Frey, C.: a volumetric background representation. ISPRS Hannover Improvement of predictive energy efficiency optimization Workshop 2017: High-Resolution Earth Imaging for Geospatial using long distance horizon estimation. IEEE Intelligent Vehicles Information (HRIGI), Hannover, 6.-9.6.2017 Symposium 2017, USA, Redondo Beach, Kalifornien, 11.-14.6.2017
Geisler, J.: Haas, C.: Verteidigungs- und Sicherheitsforschung in der Wissen und Prüfung von Menschen und Produkten-Security Fraunhofer-Gesellschaft: Aktuelle Themen und Trends. Testlab und Academy. VDMA Infotag Industrial Security, Anlässlich Mitgliederversammlung der Carl-Cranz-Gesellschaft e. V., Frankfurt a. M., 22.2.2017 Oberpfaffenhofen, 12.5.2017 Häufel, G.; Bulatov, H.: Giese, K.: Sensor Data Fusion for Textured Reconstruction and Virtual Differential Evolution in Production Process-Optimization Representation of Alpine Scenes. SPIE Remote Sensing 2017, of Cyber Physical Systems. 3. Fachkonferenz Maschinelles Polen, Warschau, 11.-14.9.2017 Lernen in der Produktion (ML4CPS 2017), Lemgo, 25.10.2017 Hammer, M.; Hebel, M.; Arens, M.: Gladysz, S.: Person detection and tracking with a 360° LiDAR system. Nearly complete characterization of optical turbulence with SPIE Security + Defence 2017, Polen, Warschau, 11.-14.9.2017 an LED array. Turbulence Profiling Workshop, Frankreich, Marseille, 21.-22.3.2017 Heinze, N.; Brandstetter, A. (Hensoldt Sensors): Manned Unmanned Teaming LOI 3 Sensorfusion – Integration Gladysz, S.: von UAS-Videofunktionen in bemannte fliegende Systeme. Nearly Complete Characterization of Optical Turbulence with SGW-Forum Unmanned Vehicles VI, Bonn Bad Godesberg, an LED Array. OSA Imaging and Applied Optics Congress, USA, 4.-5.7.2017 San Francisco, Kalifornien, 25.-29.6.2017 Heizmann, M.: Gladysz, S.; Barros, R.: Industrielle Bildverarbeitung – die wachen Augen der Characterization of underwater optical turbulence on the Qualitätssicherung. 4. Innovationsforum Quality Engineering, example of the Rayleigh-Benard water tank. SPIE Remote Konradin-Verlag, Echterdingen, 11.10.2017 Sensing, Polen, Warschau, 10.-15.9.2017 Heizmann, M.: Großmann, P.: Technologien und Anwendungen von morgen – Ausgewählte Thermisches Objektmodell (F-TOM) zur Vorhersage der Trends in der Bildverarbeitung. Fraunhofer Vision Technologietag Temperatur von Objekten und Hintergründen in unterschiedli- 2017-Jubiläumskongress 20 Jahre Fraunhofer Vision, Fürth, chen spektralen Bändern. 9. DWT-Tagung Optik und Optronik 25.-26.10.2017 in der Wehrtechnik, Meppen, 25.-28.9.2017
158 Heizmann, M.: Jacoby, M.: --Theorie und Methoden der 3D-Vermessung von Oberflächen. Approaches to Semantic Interoperability & Semantic Mapping. --Texturanalyse. Workshop on IoT Semantic / Hypermedia Interoperability, Tschechien, Seminar »Inspektion und Charakterisierung von Oberflächen mit Prag, 15.-16.7.2017 Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 5.-6.12.2017 Kannegieser, E.: Heizmann, M.: E-Learning A.I. for Simulations and Serious Games in Image Texturanalyse. Seminar »Inspektion und Charakterisierung von Interpretation. Workshop on Artificial Intelligence, EDA, Belgien, Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Brüssel 31.5.2017 Karlsruhe, 5.-6.12.2017 Kaufmann, I.: Hesse, N.; Schroeder, S.; Müller-Felber, W.; Bodensteiner, C.; Arens, Aktive Sensorik für den Nahbereich. Seminar SE 1.04 »Neue M.; Hofmann, U.: Lasersensoren für den militärischen und sicherheits-relevanten Einsatz« Markerless motion analysis for early detection of infantile der Carl-Cranz-Gesellschaft e.V., Ettlingen, 9.5.2017 movement disorders. EMBEC & NBC 2017, Joint Conference of the European Medical and Biological Engineering Conference and the Keßler, S.; Wittenstein, W.: Nordic-Baltic Conference on Biomedical Engineering and Medical ECOMOS Scientific Background: TRM4. EDA ECOMOS Workshop, Physics, Finnland, Tampere, 11.-15.6.2017 Ettlingen, 21.6.2017
Hesse, N.; Bodensteiner C.; Arens, M.; Hofmann, U.: Kiefer, P.; Winkelmann, M.: Body Pose Estimation in Depth Images for Infant Motion Analysis. Angular dependence of spectral reflection for different materi- 39th Annual International Conference of the IEEE Engineering in als. SPIE Remote Sensing, Polen, Warschau, 10.-15.9.2017 Medicine and Biology Society, Südkorea, Jeju Island, 11.-15.7.2017 Kippe, J.; Pfrang, S.: Heymann, S.: Network and Topology Models to Support IDS Event Processing. OPC UA Workshop. Smart Factory Web Projekt (Keti), Südkorea, 3rd International Conference on Information System Security and Pangyo, 17.-21.7.2017 Privacy ICISSP, Portugal, Porto, 18.-22.2.2017
Hild, J.; Krüger, W.; Brüstle, S.; Trantelle, P.; Unmüßig, G.; Voit, M.; Krieg, J.: Heinze, N.; Peinsipp-Byma, E.; Beyerer, J.: Kurzwelliges Infrarot für Nachtsichtanwendungen – Beleuch- Pilot study on real-time motion detection in UAS video data tungsniveaus und Sensorleistung. 9. DWT-Tagung, Optik und by human observer and image exploitation algotithm. Optronik in der Wehrtechnik, Meppen, 25.-28.9.2017 SPIE Conference on Defence and Commercial Sensing, USA, Anaheim, Kalifornien, 9.-13.4.2017 Krause, J.: Benchmark mobile sensors; What is the ability of the new cheap Hillemann, M.; Jutzi B. (KIT): consumer sensors? OCM-SpectroNet Collaboration Conference UCalMiCeL-UNIFIED INTRINSIC AND EXTRINSIC CALIBRATION 2017, Karlsruhe, 21.3.2017 OF A MULTI-CAMERA-SYSTEM AND A LASERSCANNER. International Conference on Unmanned Aerial Vehicles in Geomatics Kühnert, C.: (UAV-g), Bonn, 4.-7.9.2017 Web-basierte Plattform für Condition Monitoring und Optimie- rung von Produktionsprozessen des Mittelstandes basierend auf Höfer, S.: maschinellen Lernverfahren. Forschungstag Baden-Württemberg IR-Deflektometrie. IR-Kamera-Workshops, Ettlingen, 15.3.2017 Stiftung 2017, Stuttgart, 29.6.2017 und 11.7.2017 Kühnert, C.: Hoppe, A.H.; van de Camp, F.; Stiefelhagen, R.: A Modular Architecture for Smart Data Analysis using Automa- Interaction with Three Dimensional Objects on Diverse Input tionML, OPC-UA and Data-driven Algorithms. ML4CPS-Machine and Output Devices: A Survey. International Conference on Learning for cyber-physical-systems, Karlsruhe, 29.9.2017 Human-Computer Interaction, Kanada, Vancouver, 9.-14.7.2017 Längle, T.: Ihrig, R.; Kuny, S.; Thiele, A.; Hinz, S. (KIT): Optische Inspektion und Sichtprüfung. Institutsseminare des Analysis of Phenological Changes of High Vegetation in Fraunhofer IPMS, Dresden, 6.7.2017 Amplitude Images of SAR Time Series. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017
159 LECTURES 2017 VORTRÄGE 2017
Längle, T.: Meidow, J.; Förstner, W. (Institut für Geodäsie und Geoinformation, Hyperspectral Imaging-Revolution oder Evolution in der Universität Bonn): industriellen Sichtprüfung? Seminar T.O.P. 2017-Technische Optik Utilizing the Uncertainty of Polyhedra for the Reconstruction in der Praxis, Göttingen, 6.9.2017 of Buildings. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover Workshop), Hannover, 6.-9.6.2017 Längle, T.: Ressourceneffizienz durch intelligente Sortierung. Forum auf Meier, D.; Pfrang, S.: dem Ressourceneffizenz-und Kreislaufwirtschaftskongress, Stuttgart, On the Detection of Replay Attacks in Industrial Automation 19.10.2017 Networks Operated with Profinet IO. 3rd International Conference on Information Systems Security and Privacy ICISSP, Portugal, Porto, Längle, T.: 18.-22.2.2017 Hyperspectral Imaging – Revolution oder Evolution in der indus- triellen Sichtprüfung? Fraunhofer VISION Technologietag 2017 und Meier, D.: Jubiläumskongress 20 Jahre Fraunhofer Vision, Fürth, 26.10.2017 Herausforderungen der industriellen IT-Sicherheit. BMU Strategie-und Expertenforum 2017, Einbeck, 4.-5.5.2017 Längle, T.: Bildgewinnung bei der Oberflächenprüfung. Fraunhofer VISION- Meier, D.: Seminar mit Praktikum: Inspektion und Charakterisierung Entwurf und Einsatzszenarien eines Sicherheitslabors für von Oberflächen mit Bildverarbeitung, Karlsruhe, 5.12.2017 Industrie 4.0. Erfahrungsaustausch Technologie: IT-Sicherheit im Industrie 4.0 Zeitalter, Kirchheim b. München, 30.5.2017 Lutzmann, P. --Gated-Viewing Systeme. Meyer, J.: --Laser Vibrometrie. Plenoptische Bildaufnahme und –Auswertung zur automatischen Seminar SE 1.04 »Neue Lasersensoren für den militärischen und Sichtprüfung transparenter Objekte. Regelungstechnischen sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Kolloquium 2017, Boppard, 16.-17.2.2017 Oberpfaffenhofen, 10.5.2017 Meyer, J.: Lutzmann, P. fastGCVM: A Fast Algorithm for the Computation of the Discrete Penetration of pyrotechnic effects with SWIR laser gated-viewing Generalized Cramér-von Mises Distance. 25th International in comparison to VIS and thermal IR bands. 12th International Conference in Central Europe on Computer Graphics, Visualization ITBM&S Workshop (IR Target and Background, Modeling and and Computer Vision 2017 (WSCG 2017), Tschechien, Plzen, 1.6.2017 Simulation), Ettlingen, 26.6.2017 Meyer, J.: Maier, A.: General Cramér-von Mises, a Helpful Ally for Transparent Object Prozessoptimierung und Predictive Maintenance durch Inspection using Deflection Maps? 20th Scandinavian Conference on Maschinelles lernen. 22. Industrial Communication Congress, Image Analysis (SCIA 2017), Norwegen, Tromsø, 13.6.2017 Bad Pyrmont, 8.3.2017 Meyer, J.: Maier, A.: Towards Light Transport Matrix Processing for Transparent Use Cases für Big Data: Vorteile und Grenzen. Podiumsdiskussion Object Inspection. IEEE Computing Conference 2017, UK, London, auf der VDI-Tagung »Technische Zuverlässigkeit«, Leonberg bei 19.7.2017 Stuttgart, 17.5.2017 Michaelsen, E.; Schwan, G.; Scherer-Negenborn, N.: Maier, G.: Designing observer trials for image fusion experiments with Improving material characterization in sensor-based sorting Latin Squares. SPIE Defense + Commercial Sensing 2017, USA, by utilizing motion information. 3rd Conference on Optical Anaheim, Kalifornien, 10.-12.4.2017 Characterization of Materials (OCM 2017), Karlsruhe, 23.3.2017 Michaelsen, E.: Maier, S.; van de Camp, F.; Hafermann, J.; Wagner, B.; Automatic Target to Background Discrimination by Hierarchical Peinsipp-Byma, E.; Beyerer, J.: Gestalt Grouping. International IR Target and Background Modeling The image interpretation workstation of the future: lessons & Simulation Workshop ITBM&S, Ettlingen, 26.-29.6.2017 learned. SPIE Conference on Defence and Commercial Sensing, USA, Anaheim, Kalifornien, 9.-13.4.2017
160 Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Philipp, P.; Fischer, Y.; Beyerer, J.: Dachsbacher, C.; Wörn, H.: Expert-based Probabilistic Modeling of Workflows in Context of Probabilistic Surface Inference for Industrial Inspection Planning. Surgical Interventions. Conference on Cognitive and Computational IEEE Winter Conference on Applications of Computer Vision 2017, Aspects of Situation Management CogSIMA 2017, USA, Savannah, USA, Santa Rosa, Kalifornien, 29.3.2017 Georgia, 27.-31.3.2017
Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Pohl, M.; Meidow, J.; Bulatov, D.: Dachsbacher, C.; Wörn, H.: Simplification of Polygonal Chains by Enforcing Few Distinctive Image formation simulation for computer-aided inspection Edge Directions. SCANDINAVIAN CONFERENCE ON IMAGE ANALYSIS planning of machine vision systems. SPIE Optical Measurement (SCIA 2017), Norwegen, TROMSØ, 12.-14.6.2017 Systems for Industrial Inspection X, Deutschland, München, 26.6.2017 Renkewitz, H.: Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; DEDAVE – ein autonomes Unterwasserfahrzeug für die Dachsbacher, C.; Wörn, H.: Erkundung der Tiefsee. Forum Unmanned Vehicles IV, Bonn, A Versatile Hardware and Software Toolset for Computer Aided 4.7.2017 Inspection Planning of Machine Vision Applications. International Conference on Information Systems Architecture and Roller, W.; Pfisterer, D.: Technology 2017, Polen, Szklarska Poręba, 18.9.2017 Serious Games als Framework für eine lehrgangsbegleitende Lernhilfe. DWT Tagung »Simulation in und für die Ausbildung«, Pak, A.: Bad Godesberg, 7.-9.2.2017 Measuring shape of a mirror with a moving camera. SPIE Optical Metrology, München, 26.6.2017 Roller, W.: Synthetisches Apertur Radar – Grundlagen. Fachtechnische Peinsipp-Byma, E.: Grundlagen-Informationstechnik und Elektronik, BiZBw, Mannheim, Rechnergestützte Satelliten- und Luftbildauswertung. 11.5.2017 Seminar FA 1.06 »Aufklärung mit moderner Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 30.5.2017 Scharaw, B.: Urban Water Management. Agricultural University of Inner Pethig, F.; Jasperneite, J.: Mongolia, China, Hohhot, 23.-24.2.2017 Industrie 4.0-Kommunikation mit OPC UA Anwendungsfälle, Mehrwerte und Migrationsstrategie. 13. Fachtagung »Digital Scharaw, B.: Engineering Technischer Systeme-Der Weg zur Smart Factory«, De-centralized Urban Water Management. L.N. Gumilyov Magdeburg, 22.6.2017 Eurasian National University, Kasachstan, Astana, 3.5.2017
Pethig, F.: Schleipen, M.: Einfach anfangen mit dem Werkzeugkasten OPC UA. Machine to Machine Communication in Industry 4.0 OPC UA in Anwendung-Infotag, Frankfurt a. M. 5.7.2017 Environments. Global Smart Manifacturing Summit, Frankfurt a. M., 30.3.2017 Pethig, F.; Niggemann, O.: Towards Industrie 4.0 Compliant Configuration of Condition Schulte, H.: Monitoring Services. IEEE 15th International Conference on Spektrale Messungen. Hausseminar der Firma Testo SE & Co. KGaA, Industrial Informatics INDIN‘2017, Emden, 24.7.2017 Titisee-Neustadt, 11.7.2017
Pethig, F.: Schwarz, A.: IoT erleben – openAAS als Basis für Industrie 4.0. 2. VDI-Fach- Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs konferenz »Intelligente Sensoren für Industrie 4.0 – Herausforderungen SE2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« und Technologie im Spannungsfeld von Cloud und RetroFit«, der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 22.6.2017 Baden-Baden, 18.10.2017 Schwarz, A.: Pfrang, S.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs Entwurf und Einsatzszenarien eines Sicherheitslabors für Grundlagen der Optronik, Bildungszentrum der Bundeswehr, Industrie 4.0. Erfahrungsaustausch Technologie: IT-Sicherheit im Mannheim, 27.9.2017 Industrie 4.0 Zeitalter, Kirchheim b. München, 30.5.2017
161 LECTURES 2017 VORTRÄGE 2017
Schwarz, A.: Streicher, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE1.02 Serious Games: Spielend leicht(er) lernen? Multimediawerkstatt, »Infrarottechnik-Grundlagen, Trends und moderne Anwendungen« Studium Digitale, Goethe Universität Frankfurt a. M., 18.7.2017 der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 19.10.2017 Streicher, A.: Schwarz, A.: Interoperable Adaptivity and Learning Analytics for Serious Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs Games in Image Interpretation. EC-TEL 2017, Estland, Tallinn, SE2.14 »Radar-; VIS- und IR-Signaturen: Technik und Anwendung« 12.-14.9.2017 der Carl-Cranz-Gesellschaft e.V., 29.11.2017 Streicher, A.: Schweitzer, C.; Wendelstein, N., Stein, K.: Application of Adaptive Game-based Learning in Image Infrared measurements of launch vehicle exhaust plumes. Interpretation. ECGBL 2017, Österreich, Graz, 4.-7.10.2017 SPIE Security & Defence, Polen, Warschau, 10.-15.9.2017 Strentzsch, G.; van de Camp, F.; Stiefelhagen, R.: Schweitzer, C.: Digital Map Table VR: Bringing an Interactive System to Virtual The influence of the atmosphere on the performance of Reality. International Conference on Human-Computer Interaction, electro-optical systems-Measuring rocket exhaust plumes. Raum- Kanada, Vancouver, 9.-14.7.2017 fahrtprogramm REXUS / BEXUS-Workshop, DLR Oberpfaffenhofen, 20.-21.2.2017 Usländer, T.: Agiles Service Engineering mit der Methode SERVUC. Schweitzer, C.: GPM-Veranstaltung »System Engineering im Zeitalter des Industrial Simulation of atmospheric and terrestrial background Internet und Industrie«, IOSB Karlsruhe, 19.1.2017 signatures for detection and tracking scenarios. ITBM&S, IOSB Ettlingen, 26.-29.6.2017 Usländer, T.: Industrie 4.0 and Smart Factories–Analysis and Implementation Schweitzer, C.: Strategies. 1st Smart Factory Conference, Griechenland, Athen, Messungen Kiruna 2017 und Hintergrundsimulation. Workshop 22.2.2017 Erweiterte Luftverteidigung-IR, Airbus Oberpfaffenhofen, 20.7.2017 Usländer, T.: Schweitzer, C.: DIN Spec 16593 RM-SA–Referenzmodell für Industrie 4.0 Service- Satellitenbasierte Frühwarnung-Detektion und Tracking von architekturen. Sitzung AG 1, Industrie 4.0, Ratingen, 14.3.2017 Flugkörpern. Workshop Hypersonische Flugkörper, INT Euskirchen, 17.8.2017 Usländer, T.: DIN Spec 16593: Referenzmodell für Industrie 4.0 Service Sidorenko, J.; Scherer-Negenborn, N.; Arens, M.; Michaelsen, E.: Architekturen – Grundkonzepte einer interaktionsbasierten Improved Linear Direct Solution for Asynchronous Radio Architektur. DIN Forum, Hannover Messe Industrie, Hannover, Network Localization (RNL). ION Pacific PNT conference, USA, 24.-28.4.2017 Honolulu, Hawaii, 1.-4.5.2017 Usländer, T.: Stojanovic, L.: Establishing a secure web of smart factories-architecture, Fog Computing: Herausforderungen und Möglichkeiten. standards and technologies. Bitkom Innovation Forum, Hannover Innovationstag »Cloud and Fog Computing« der IHK Reutlingen, Messe Industrie, Hannover, 24.-28.4.2017 Reutlingen, 3.7.2017 Usländer, T.: Stojanovic, L.: Agile Service Engineering – a key competence for Industrial Intelligent edge processing. ML4CPS, Lemgo, 25.-26.10.2017 Internet Applications. 8th International Workshop on Optimisation for Logistics and Industrial Applications IWOLIA, Frankreich, Troyes, Streicher, A.: 9.-10.5.2017 Web-basiertes Serious Game für Training im Verbund. LEARNTEC 2017, Karlsruhe, 24.-26.1.2017 Usländer, T.: Smart Factory Web-an IIC Testbed on Production Market Places. Streicher, A.: Industry of Things World, Berlin, 18.-19.9.2017 Interoperable Adaptivity and Learning Analytics for Serious Games in Image Interpretation. IEEE ICE ITMC 2017, Portugal, Madeira, 27.-29.6.2017
162 Usländer, T.: Woock, P.; Beyerer, J.: IT Security in Industrie 4.0 Systemarchitekturen–wie lauten die Physically Based Sonar Simulation and Image Generation for Spezifika? IoT Security Strategiedialog, Frankfurt a. M., 26.-27.9.2017 Side-Scan Sonar. 4th Underwater Acoustics Conference and Exhibition (UACE) 2017, Griechenland, Skiathos, 4.-8.9.17 Wagner, B.; Maier, S.; Peinsipp-Byma, E.: Standardized acquisition, storing and provision of 3D enabled Wuttke, S.; Middelmann, W.; Stilla, U. (TU München): spatial data. SPIE Conference on Defence and Commercial Sensing, Improving active queries with a local segmentation step and USA, Anaheim, Kalifornien, 9.-13.4.2017 application to land cover classification. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover Workshop), Hannover, Warnke, S.; Bulatov, D.: 6.-9.6.2017 Variable Selection for Road Segmentation in Aerial Images. CMRT17 – City Models, Roads and Traffic 2017 (ISPRS Hannover Zaschke, C.: Workshop), Hannover, 6.-9.6.2017 Adaptation of interoperability standards for cross domain usage. SPIE Defense + Commercial Sensing 2017, USA, Anaheim, Watson, K.: Kalifornien, 9.-13.4.2017 IIC Testbed Smart Factory Web und Konsequenzen für das Projektmanagement. GPM-Veranstaltung System Engineering Ziebarth, M.; Stephan, T.; Höfer, S.; Burke, J.: im Zeitalter des Industrial Internet und Industrie, IOSB Karlsruhe, Mustererzeugung zum Phasenschieben durch Rotation für Karlsruhe, 19.1.2017 die Deflektometrie. Jahrestagung DGaO, Deutschland, Dresden, 7.6.2017 Watson, K.: Establishing a secure web of smart factories - architecture, Ziehn, J.: standards and technologies. Industry 4.0 for Plastics Processors Recent Automated Driving Developments. 2017, Köln, 7.3.2017 KSS Research Workshop, Karlsruhe, 21.-22.9. 2017
Watson, K.: Ziehn, J.: Smart Factory Web. IIC Quarterly Meeting, USA, Reston, Virginia, Wie entscheidet das Fahrzeug für uns? Profilregion-Seminarreihe: 20.-24.3.2017 Der Weg zum Autonomen Fahren, Karlsruhe, 17.10.2017
Watson, K.: Smart Factory Web with OPC UA and Automation ML. Smart Factory EXPO, OPC Day Korea, Südkorea, Seoul, 29.-31.3.2017
Watson, K.: IIC Testbed Smart Factory Web. Steinbeis Engineering Tag, Stuttgart, 5.4.2017
Watson, K.: AutomationML - Industrie 4.0 Candidate Standard for Asset Model Engineering and Plug & Work. Internet of Things and Model based Engineering in Manufacturing, Belgien, Brüssel, 7.6.2017
Welte, A.; Hammer, H.; Thiele A.; Hinz, S. (KIT): Building Change Detection in Time Series of TanDEM-X Interfe- rograms. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017
Willersinn, D.: Resilientes kooperatives Fahren im Mischverkehr. Forum Elektromobilität, Berlin, 2.6.2017
Willersinn, D.: Autonomes Fahren am Fraunhofer IOSB. 5. Netzwerktreffen FutureCar, München, 25.-26.7.2017
163 VERNISSAGES VERNISSAGEN IOSB Karlsruhe
Photographs, paintings and Fotografien, Malereien und sculptures – 2016 and 2017 Skulpturen – 2016 und 2017 Fraunhofer IOSB had all of them. war all dies im Fraunhofer IOSB zu sehen.
2016
164 2017
165 VISIT MAGAZINE THEMENBROSCHÜRE VISIT
2016
2017
2018 PLANNED ISSUES:
MOBILE ROBOTERSYSTEME
PRIVACY BY DESIGN UND IT-SICHERHEIT
GESCHÄFTSFELD ENERGIE, WASSER UND UMWELT
166 EDITORIAL NOTES IMPRESSUM
Photo acknowledgements Published by Fraunhofer Institute of Cover, Page 2, 7, 11, 30, 32, 54/55, 62, 76, 82/83, 84 above, Optronics, System Technologies 86 above, 90/91, 90/91, 92/93, 94, 95, 96/97, 102, 104/105, and Image Exploitation IOSB 106/107, 108/109 above, 110/111, 112, 114/115 above, Director: Prof. Dr.-Ing. habil. 116/117 above, 118/119, 120: Jürgen Beyerer indigo - Studio für Werbefotografie photographer: Manfred Zentsch Editor Ulrich Pontes Page 23 above: Depositphotos Inc., USA Layout Christine Spalek Page 46/47 above, 123, 129: MEV Proofreading BBK Gesellschaft für moderne Sprachen mbH 76726 Germersheim All other images: Fraunhofer IOSB Printed by Kraft Premium GmbH 76275 Ettlingen
Editorial Deadline April 2018
Contact: Fraunhofer IOSB Press and Communications Fraunhoferstraße 1 76131 Karlsruhe Phone +49 721 6091-300 Fax +49 721 6091-413 [email protected]
All rights reserved. Reproduction of any material is subject to edito- rial authorization.
© Fraunhofer IOSB PLANNED ISSUES: Karlsruhe 2018 Institute of the Fraunhofer Gesellschaft, Munich MOBILE ROBOTERSYSTEME
PRIVACY BY DESIGN UND IT-SICHERHEIT
GESCHÄFTSFELD ENERGIE, WASSER UND UMWELT
167 ADRESSES ADRESSEN
Karlsruhe Fraunhoferstraße 1 76131 Karlsruhe Telefon +49 721 6091-0 Fax +49 721 6091-413 [email protected] www.iosb.fraunhofer.de KARLSRUHE Leitung Prof. Dr.-Ing. habil. Jürgen Beyerer Telefon +49 721 6091-210 [email protected]
Presse und Kommunikation Dipl.-Phys. Ulrich Pontes Telefon +49 721 6091-300 [email protected] ETTLINGEN Verwaltung Dipl.-Kaufm. Siegbert Böckle Telefon +49 721 6091-350 [email protected]
Ettlingen Gutleuthausstraße 1 76275 Ettlingen ILMENAU Telefon +49 7243 992-0 Fax +49 7243 992 298
Leitung Bereich Photonik und optronische Systeme Prof. Dr. rer. nat. habil. Marc Eichhorn Telefon +49 7243 992-131 GÖRLITZ [email protected]
Institutsteil Angewandte Systemtechnik AST Am Vogelherd 50 98693 Ilmenau Telefon +49 3677 461-103 Fax +49 3677 461-100 LEMGO steffi.nothnagel@ iosb-ast.fraunhofer.de Institutsteil für industrielle Fraunhofer Representative Social-Media-Kanäle www.iosb-ast.fraunhofer.de Automation INA Office Beijing Außenstelle Görlitz, Langenbruch 6 Abteilung Energie 32657 Lemgo Representative for Production Brückenstraße 1 Telefon +49 5261 702-5998 and Information Technologies 02826 Görlitz Fax +49 5261 702-5969 Unit 0610 Landmark Tower II twitter.com/FraunhoferIOSB Telefon +49 3581 79255354 [email protected] 8 North Dongsanhuan Road [email protected] www.iosb-ina.fraunhofer.de Chaoyang District 100004 Beijing Leitung facebook.com/FraunhoferIOSB PR China Prof. Dr.-Ing. habil. Leitung Thomas Rauschenbach Prof. Dr.-Ing. Jürgen Jasperneite Dipl.-Ing. Hong Mu Telefon +49 3677 461-124 Telefon +49 5261 702-572 Telefon +86 10 65900 621 linkedin.com/company/fraunhofer-iosb thomas.rauschenbach@ juergen.jasperneite@ Fax +86 10 65900 619 iosb-ast.fraunhofer.de iosb-ina.fraunhofer.de [email protected] s.fhg.de/Youtube-IOSB
168 FRAUNHOFER UNITS IN GERMANY FRAUNHOFER IOSB IN A NUTSHELL
Development of innovative cameras. Optimal use and net-working of sensors. Processing and analyzing the resulting data streams according to the task at hand, leading to decision Funding support systems for humans or intelligent control mechanisms for autonomous systems. This comprehensive process and exploitation chain, which comprises and combines the core Public sector competences Optronics, System Technologies and Image Industrial sektor 27,1% Exploitation, is our domain at Fraunhofer IOSB. 40,3%
Our expertise comes to use in areas as diverse as automation, inspection or security. Like the Fraunhofer-Gesellschaft as a Others 6,4% whole, we are committed to application-oriented research Basic funding for the benefit of society and economy. We shape the future. 36% Scientific and technological excellence are just as much a part of our DNA as customer orientation and reliability towards our clients from industry and public authorities.
Business expenses Staff 60 Full-time positions
500 50
400 40
300 30
200 20
100 10
13 14 15 16 17 13 14 15 16 17
Personnel in total Investment
Scientists / engineers Research expenditure more at: www.standortkarte.fraunhofer.de
Others FRAUNHOFER INSTITUTE OF OPTRONICS, SYSTEM TECHNOLOGIES AND IMAGE EXPLOITATION
FRAUNHOFER-INSTITUT FÜR OPTRONIK, SYSTEMTECHNIK UND BILDAUSWERTUNG IOSB
KARLSRUHE FRAUNHOFERSTRASSE 1 76131 KARLSRUHE TELEFON +49 721 6091-0
ETTLINGEN GUTLEUTHAUSSTRASSE 1 76275 ETTLINGEN TELEFON +49 7243 992-0
ILMENAU INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AM VOGELHERD 50 98693 ILMENAU TELEFON +49 3677 461-0
GÖRLITZ INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AUSSENSTELLE GÖRLITZ ABTEILUNG ENERGIE BRÜCKENSTRASSE 1 02826 GÖRLITZ TELEFON +49 3581 7925354
LEMGO INSTITUTSTEIL FÜR INDUSTRIELLE AUTOMATION (INA) LANGENBRUCH 6 32657 LEMGO TELEFON +49 5261 94290-22 ANNUAL REPORT
WWW.IOSB.FRAUNHOFER.DE
Fraunhofer IOSB Annual Report 2017 / 2018 2017 / 2018