Master Thesis Czech Technical University in Prague Faculty of Electrical Engineering F3 Department of Cybernetics Remote control touch panel for Thermal Smart Camera Ján Marek Supervisor: Ing. Jan Kovář Supervisor–specialist: doc. Ing. Daniel Novák, Ph.D. January 2019 ii MASTER‘S THESIS ASSIGNMENT I. Personal and study details Student's name: Marek Ján Personal ID number: 406310 Faculty / Institute: Faculty of Electrical Engineering Department / Institute: Department of Cybernetics Study program: Cybernetics and Robotics Branch of study: Robotics II. Master’s thesis details Master’s thesis title in English: Remote Control Touch Panel for Thermal Smart Camera Master’s thesis title in Czech: Dotykový ovládací panel pro termovizní smartkameru Guidelines: 1) Get familiar with the thermal smart-camera SMARTIS, communication interface and usage of the camera in industry (working modes and operator settings). 2) Find a suitable platform for creating the touch panel and select the appropriate display screen, central and peripheral board for connection of the thermal smart-camera. The central process platform must support OS Linux and libraries for image processing and communication through an Ethernet IP. 3) According to the selected platform try and run OS Linux and development tools for the design of application software of the future control panel. 4) Propose and implement the optimal transmission and display of the thermal image depending on the options of the camera and selected platform. 5) Design and implement the application and graphical interface for remote access and control of the thermal smart-camera SMARTIS. Implement separate interface for the administrator and operator user. 6) Test the designed application and evaluate future development options. Bibliography / sources: [1] Vollmer, Michael; Möllmann, Klaus-Peter: Infrared Thermal Imaging: Fundamentals, Research and Applications, First Edition, Wiley-VCH, 2010. [2] Davies, E. R.: Computer and Machine Vision: Theory, Algorithms, Practicalities, Fourth Edition, Academic Press, 2012. [3] Yaghmour, Karim; Masters, Jon: Building Embedded Linux Systems, Second Edition, O'Reilly Media, 2008. Name and workplace of master’s thesis supervisor: Ing. Jan Kovář, Workswell s.r.o., Prague Name and workplace of second master’s thesis supervisor or consultant: doc. Ing. Daniel Novák, Ph.D., Analys. and Interpr.of Biomed. Data, FEE Date of master’s thesis assignment: 12.01.2018 Deadline for master's thesis submission: 08.01.2019 Assignment valid until: 30.09.2019 ___________________________ ___________________________ ___________________________ Ing. Jan Kovář doc. Ing. Tomáš Svoboda, Ph.D. prof. Ing. Pavel Ripka, CSc. Supervisor’s signature Head of department’s signature Dean’s signature CVUT-CZ-ZDP-2015.1 © ČVUT v Praze, Design: ČVUT v Praze, VIC III. Assignment receipt The student acknowledges that the master’s thesis is an individual work. The student must produce his thesis without the assistance of others, with the exception of provided consultations. Within the master’s thesis, the author must state the names of consultants and include a list of references. Date of assignment receipt Student’s signature CVUT-CZ-ZDP-2015.1 © ČVUT v Praze, Design: ČVUT v Praze, VIC Acknowledgements Declaration My first thanks is to the supervisor Ing. I declare that the presented work was Jan Kovář and the company Workswell developed independently and that I s.r.o. for allowing me to work on this have listed all sources of information project under their care. used within it in accordance with the I would like to thank my parents and methodical instructions for observing my whole family for their support and in- the ethical principles in the preparation finite patience. I also thank my girlfriend of university thesis. that was standing next to me every day and supporting me morally. Prague, date . Last but not least, I would like to thank the CVUT and my faculty for allowing signature me to gain strong knowledge and experi- ence for the future life. v Abstract Abstrakt Main goal of the diploma work is to find Hlavním cílem diplomové práce je na- suitable platform and develop a graphi- jít vhodnou platformu a vyvinout grafic- cal application for a remote control touch kou aplikaci pro dotykový ovládací panel, panel, for thermal smart camera SMAR- pro termovizní smart kameru SMARTIS. TIS. The application contains two modes, Aplikace obsahuje dva módy, pro Operá- for Operator and Administrator user. tora a Administrátora. In the thesis I describe the pro- V této práci popisuji proces výběru cess of choosing the single board com- jednodeskového počítače, instalaci puter, installation of the operating sys- operačního systému a hlavní vývoj apli- tem and main development of the appli- kace. Později pak uvádím proces cross cation. Later I state the process of cross- kompilace na finální platformu. compilation for the final platform. Grafická aplikace je napsána v jazyku The graphical application is written in C++ s použitím knihoven Qt. Hlavní C++ using the Qt libraries. The main funkce aplikace jsem popsal v diplomové functions of the application with exam- práci spolu s uvedením příkladu. Apli- ples are described in the thesis. The ap- kace byla testována na dlouhodobou sta- plication was tested for long term stabil- bilitu a je zcela funkční. ity and is fully functional. V budoucnosti bude aplikace dále zdo- In the future the application will be fur- konalována a budou přidány nové funkce. ther improved and new functions will be Cílem je integrovat dotykový ovládací pa- added. The goal is to integrate the re- nel přímo ke kameře a potenciálně jej mote control touch panel directly to the uvést na trh. camera and potentially introduce it to the market. Klíčová slova: termální zobrazování, termovizní kamera, industriální, vývoj Keywords: thermal imaging, thermal aplikace, jednodeskový počítač, Qt, camera, industrial, application dotykový panel development, single-board computer, Qt, touch panel Překlad názvu: Dotykový ovládací panel pro termovizní smartkameru Supervisor: Ing. Jan Kovář Workswell s.r.o., Libocká 653/51b, 161 00, Praha 6 vi Contents 1 Introduction 1 5.1.1 SMARTIS environment 1.1 Motivation . 2 preparation . 25 1.1.1 General Use . 2 5.1.2 Library overview . 25 1.1.2 Personal motivation . 3 5.2 Login window functions . 26 1.2 Goals . 3 5.2.1 SMARTIS connection . 27 1.2.1 Limitations . 4 5.2.2 Password encrypting . 28 1.3 Existing alternatives and solutions 4 5.3 User window functions . 28 1.3.1 FLIR ThermoVision CM . 5 5.3.1 Camera image widget. 29 1.3.2 Infratec PRESS-CHECK . 5 5.3.2 Real time data displaying . 32 1.4 Overview of the final product . 5 5.4 Administrator window functions 34 2 Feasibility analysis 7 5.4.1 General settings . 35 2.1 SMARTIS . 7 5.4.2 Product creation . 36 2.1.1 User modes . 7 5.4.3 Product settings . 36 2.1.2 Products overview . 7 5.4.4 Radiometry settings . 36 2.1.3 ROI . 8 5.4.5 Camera mode settings . 37 2.1.4 Inputs and outputs . 8 5.4.6 Region of interest selection . 37 2.1.5 Measurement modes . 8 5.4.7 Statistic settings . 37 2.2 Ethernet communication . 9 5.4.8 Output settings . 37 5.4.9 Visualisation settings . 38 3 Platform selection and 5.4.10 Saving of the settings . 38 preparation 11 5.5 Extra functions . 38 3.1 Platform requirements . 11 5.5.1 Keyboard . 38 3.2 Platform comparison . 12 5.5.2 Application logging . 39 3.2.1 NanoPC-T2 . 13 5.5.3 Documentation . 39 3.2.2 Rico Board . 13 3.2.3 NanoPC-T3 . 13 6 Conclusion 41 3.3 Preparation of selected platform A Final product 43 NanoPC-T3 . 14 B GUI of the application 45 3.3.1 First Linux installation . 14 3.3.2 Preparation of Ubuntu core . 15 C CD attachment 51 3.4 Summary of preparations . 15 D Bibliography 53 4 Application development 17 4.1 Selection of develomplent method 17 4.2 Preparation of development environment . 18 4.2.1 Library selection . 19 4.2.2 Cross-compilation for final platform . 19 4.2.3 Qt Creator settings . 19 4.3 Application requirements and overview . 20 4.3.1 Class dependency . 21 4.3.2 Main windows overview . 22 5 Aplication functions 25 5.1 SMARTIS firmware library development . 25 vii Figures 1.1 Example of professional A.1 Picture of the finished product, monitoring system using FLIR NanoPC-T3 running the application, thermal camera for detection of SMARTIS and LCD touch panel power plant failure. 2 connected to the board . 44 1.2 Professional thermal cameras with control panel . 5 B.1 Pictures form the General settings 1.3 Simplified scheme of the final of the Administrator mode . 45 product. The displayed devices are B.2 Pictures form the General settings not in scale . 6 of the Administrator mode and Product selection settings . 46 2.1 Workswell s.r.o. Thermal Smart B.3 Pictures form the Mode settings Camera SMARTIS . 8 of the Administrator mode . 47 B.4 Pictures from the configuration of 3.1 Considered single board selected Product by the computers for the application . 12 Administrator . 48 B.5 Pictures from finishing of the 4.1 Settings of the Qt Creator for the configuration by the Administrator main application development . 20 user . 49 4.2 Simplified class hierarchy of the application with explanation of each class . 21 4.3 Simplified scheme of the login window GUI . 22 4.4 Simplified scheme of the Operator and Administrator window GUIs, note the space for graph in the Operator window is in the current version unused . 24 5.1 The Login window as seen in the application . 27 5.2 Operator window of the application . 29 5.3 Comparison of a image with two different color palettes .