Autonomous Greenhouses - Research on Intelligent Greenhouses and Robotics

Autonomous greenhouses - research on intelligent greenhouses and robotics

Netherlands-Japan Horticulture Seminar, 21 November 2018, Tokyo, Japan

Dr. Silke Hemming Wageningen University & Research, Business Unit Greenhouse Horticulture Why do we need ”Autonomous greenhouses”?

2 3 Challenges greenhouse production

. Average famer age in Japan is 66 years: attract young people by ICT and high-tech, modern working conditions . Knowledge and skills of farmers on modern crop management . Use of ICT is essential: climate computers, ICT for data collection on climate, water, nutrients, crop growth, labour . Still: data often not connected, grower needs to decide on setpoints, grower needs to weigh yield vs. resource need Autonomous greenhouses? Artificial intelligence vs. Human intelligence

IBM DeapBlue defeats chess master Garry Kasparov in 1996

Alphabet Inc’s Google DeepMind defeats Go champion Fan Hui in 2015 (European champion) Lee Sedol in 2016 (ranked 6 in world)

Tencent Fine Art wins Computer Go UEC Cup In 2017 5 The Challenge

6 Autonomous Greenhouses

7 International challenge “Autonomous greenhouses”

International Subscription teams Idea Autonomous 15 teams Hackathon greenhouse 90 participants @WUR Bleiswijk challenge 16 nationalities

Final winnar Selection teams 5 teams Growing experiment -benchmark – 40 participants @WUR Bleiswijk -new insights – 9 nationalities - new cooperations -

8 Hackathon

24-h

Virtual cucumber growing

Using WUR’s advanced greenhouse climate & crop models

Show skills

9 Hackathon

24-h

Virtual cucumber growing

Using WUR’s advanced greenhouse climate & crop models

Show skills

10 deep_greens Engineering AI

AI Data Sensors

Zach Dwiel Alexei Bastidas Mariano Phielipp Anna Bethke ChinniKrishna Kothapalli Intel Intel Intel Intel Intel Corp.

Agrogenomic Agrogenomic Agrogenomic Data Science Sciences Sciences

Laura Rosina Torres Ortega Uriel Guadalupe Pérez Guerrero Julia Paulina Garía González Aarón Iván Vélez Ramírez BSc student at National BSc student at National BSc student at National National Autonomous University Autonomous University of Mexico Autonomous University of Mexico Autonomous University of Mexico of Mexico, prof. 11 AiCU Engineering

Software Plant Science Plant Plant Science Science

Xixi Minglan Xing Zhao Liang Li Zao Ye phD student WUR Eurotiss B.V. NXP Semiconductors IGMPR Flower, Parks & More

Mathematics Modelling Agronomy

Ningyi Zhang Xinwei Bai phD student WUR phD student University of Twente 12

The Croperators

Horticulture

Engineering Business Plant physiology Engineering

Klaas van Egmond Jeroen Boonekamp Rens Schmidt Rudolf de Vetten Delphy B.V. Delphy B.V./ MSc student WUR Delphy B.V. AgroEnergy B.V.

Data

Horticulture Management Business Engineering Horticulture

Jitse Schöne Peter Goudswaard Wim van der Ende Bram van Rens Delphy B.V. / BSc student AgroEnergy B.V. Delphy B.V. AgroEnergy B.V. 13 InHolland Sonoma

Engineering Machine Food Engineering Machine learning AI learning Business technology

Kenneth Tran Chetan Bansal Thomas Grossfeld Janine Kemmeren Microsoft Research Microsoft Research Microsoft Nederland Microsoft Nederland

Crop Horticulture Modelling protection

David Katzin Hong Phan PhD student WUR PhD student University of Copenhagen 14 iGrow

AI AI

AI Plant Science

Jinlong Hou Qing Wang Wei Liu Dijun Luo Yi Zhang Tencent Tencent Tencent Tencent MSc student WUR

Environmental Horticulture Agriculture Agriculture Science Seeds

Bo Zhou Tao Li Shengping Liu Ge Zu Lulei Yan Beijing Research Center for Chinese Academy of Chinese Academy of Botanical Society Syngenta Seeds Information Technology in Agricultural Science Agricultural Science of Heilongjiang Agriculture CAAS CAAS Province 15 The manual-grown human intelligence Reference

Reference realised by team of Dutch growers: Kees Scheffers (grower @WUR) Corné van Boxel (cucumber grower, Delfgauw) John van Marrewijk (sweet pepper grower, Kwekerij de Wieringermeer)

16 The Growing experiment

17 Our greenhouses

https://www.youtube.com/watch?v=vEyeDVr15Y0

18 Greenhouse actuators-sensors-setpoints- interface Greenhouse equipment & actuators Roof ventilation

Artificial light Sensors & Sensors

Cucumber crop information

Irrigation CO2

Heating Greenhouse actuators-sensors-setpoints- interface Greenhouse equipment & Input actuators Control setpoints climate, Roof ventilation irrgation, crop

Process computer AI algorithms Artificial light Sensors & Sensors

Cucumber crop information

Output

Irrigation CO2 Realised climate, irrigation Measured crop parameters incl. harvest 20 Heating Sensors . Teams are allowed to install additional sensors ● RGB camera ● thermal camera (own design) ● wireless sensor networks (own design ● root zone sensors ● net radiation sensor ● crop and substrate weighing sensors, crop sap flow meters, stem diameter ● no sensors

21 AI

. Teams need to develop their own AI algorithms ● cucumber growth model

● climate model AI 2 Simulation System Real Greenhouse

● human expertSimulated Environment decision ● machine learning trained on artificial data Controller RL Models Sensors

● dynamic regression analysis Controller Sensors Rules ● neural networks

Agent Agent ● deep reinforcement ExpertslearningInterface agent ● …

22 The Results

23 . Pictures from planting

24 Total production

Per 6/11

25 Net profit

Per 27/10

26 Sustainability factors per 27/10

kg CO2/ kWh electricity/ kWh heat/ L water use/ kg cucumber kg cucumber kg cucumber kg cucumber iGrow 0.33 2.65 4.14 8.73 deep_greens 0.66 5.45 12.56 7.66 Reference 0.38 2.73 3.71 8.71 AiCU 0.38 2.95 1.76 9.37 Sonoma 0.31 3.44 2.61 6.32 The Croperators 0.39 3.95 1.67 7.74

27 Some AI outperforms the grower!

28 Our jury

29 Judgement

. Teams can get points for:

. Net profit (50%) – yield vs. resources

. Sustainability factor (20%) – energy, water, CO2, (biolog.) pesticides . AI strategy (30%) – novelty, autonomous, robustness, scalability

30 Organisor Sponsors

Tech-partner 31 Robotics

32 Sweet pepper harvesting

https://www.youtube.com/watch?v=VbW1ZW8NC2E 33 Pest and disease scouting

34 Thank you for your attention!

www.autonomousgreenhouses.com http://twitter.com/HemmingSilke Eat our AI grown

http://www.linkedin.com/in/HemmingSilke cucumbers!

With thanks to my colleagues: Feije de Zwart, Isabella Righini, 35 Anne Elings, Kees Scheffers, Sjaak Bakker et al.