Sample Chapter
Total Page:16
File Type:pdf, Size:1020Kb
M MACHINE VISION Avery similar system is used for grading apples, as seen in Figures 1 and 2. Fragments of nut shell can be detected when pecan nuts See Visible and Thermal Images for Fruit Detection are shelled, once again by detection of the color. Kernels fall through the inspection area at a speed of around one meter per second. In an early system, light that was MACHINE VISION IN AGRICULTURE reflected from the kernel was split between two photocells that detected the intensity of different wavelengths. The John Billingsley ratio enabled color to discriminate between nut and shell. University of Southern Queensland, Toowoomba, QLD, More recent versions incorporate laser scanning. As the Australia nut falls further, a jet of air is switched to deflect any detected shell into a separate bin. Definition Machine vision: Visual data that can be processed by Detection of weeds a computer, including monochrome, color and infra red Color discrimination can also be used in the field to dis- imaging, line or spot perception of brightness and color, criminate between plants and weeds for the application time-varying optical signals. of selective spraying (Åstrand and Baerveldt, 2002; Zhang Agriculture: Horticulture, arboriculture and other cropping et al., 2008). It is possible for the color channels of the cam- methods, harvesting, post production inspection and era to include infra-red wavelengths, something that can be processing, livestock breeding, preparation and slaughter. achieved by removing the infra-red blocking filter from a simple webcam. Figure 3 is a low-resolution frame-grab Introduction showing one stage in the detection of a grass-like weed, The combination of low-cost computing power and applica- “panic,” during trials in sugar cane. The computer has tions that target its use for entertainment has led to a readily marked pixels determined to be “weed” in yellow. available platform for analyzing vision signals in a variety of ways. Applications are many and various, but some of Quality assessment the most potentially significant ones are found in agriculture. True machine vision concerns shape information. One example is the assessment of fodder quality. From a web- Sorting by color cam image of a sample handful of hay, the stem-widths For some decades, a simplified form of machine vision has can be measured and a histogram displayed. Color can also been used for sorting produce (Tao et al., 1995). Tomatoes be determined by comparison of the video signal against may be picked green for ripening in the shed. When their that from the image of a calibration card. This makes an color is changing, they ride a conveyor that has pockets objective standard possible, to achieve agreement between for individual fruit. These holders can be tripped by vendor and purchaser (Dunn and Billingsley, 2007). a computer signal, to eject the tomato at one of many pack- Shape information can also be used to monitor the ing stations corresponding to the degree of ripeness, as growth of a crop, measuring stem length between nodes defined by color. automatically (McCarthy et al., 2008). Jan Gliński, Józef Horabik & Jerzy Lipiec (eds.), Encyclopedia of Agrophysics, DOI 10.1007/978-90-481-3585-1, # Springer Science+Business Media B.V. 2011 434 MACHINE VISION IN AGRICULTURE Machine Vision in Agriculture, Figure 1 Apples moving towards washing and grading. Machine Vision in Agriculture, Figure 3 A frame-grab from the computer-processing of image data to locate weeds. Livestock identification A more detailed version of shape information, in the form of an s-psi profile, has been used to discriminate between animals of different species passing a checkpoint while they approach a watering place. Now the image represents the profile of the animal as seen against a background. A blue background simplifies discrimination for produc- Machine Vision in Agriculture, Figure 2 A conveyor ing a silhouette. From this a boundary can be found by automatically ejects each apple at the correct station. edge-tracing, which yields a sequence of incremental MACHINE VISION IN AGRICULTURE 435 Machine Vision in Agriculture, Figure 4 S-psi plot of the outline of a steer. their RFID tag can be read, to monitor their progress towards “harvesting.” Picking Many attempts have been made over the years to use machine vision to detect and locate fruit for automatic picking. Although positive research results have been reported, operational speeds are generally low and there has been very limited commercial success. It has been suggested that the growing availability of broadband com- munication can make it possible for “armchair pickers” to tele-operate picking machinery, with the aid of real-time imaging. Machine guidance Vision guidance has been applied with great technical suc- cess to tractors (Billingsley and Schoenfisch, 1996). Within each received image, the software locates the rows Machine Vision in Agriculture, Figure 5 Frame-grab from the of crop and assesses the control action needed to bring the video image that is steering a tractor at speed. vehicle back on course. The algorithms were developed in the early 1990s, when computing power was much less plentiful. The result is a robust strategy that can time-share with GPS analysis and other signal processing. vectors that form a “Freeman chain.” These in turn deliver Within the field of view, “keyholes” are defined that a sequence of tangent angles, to be plotted against the dis- will each contain the image of a single row. Within each tance travelled around the circumference of the silhouette, keyhole, plant images in the form of green pixels are as seen in Figure 4. regarded as data points through which to construct From the original megabyte image, some 256 bytes of a regression line. For the next image, the keyholes are data now define the shape of the animal in view, for corre- moved to be centered on these regression lines. The set lating against a set of templates to separate sheep from of two or three keyholes move at once to indicate the goats or camels from cattle. A gate is then driven to vanishing point, from which the heading error and the lat- exclude or to draft the animals. This work is being refined eral displacement can be deduced. These signals then give to assess the condition of cattle as they pass a point where a steering command to bring the tractor back on track, to 436 MACROPORE FLOW an accuracy of a centimeter or two. A frame-grab from the steering software is shown in Figure 5. MAGNETIC PROPERTIES OF SOILS The method is greatly superior to the use of GPS, satel- lite navigation, since an operation such as cultivating will Andrey Alekseev cut the ground at a point relative to the actual location of Laboratory Geochemistry and Soil Mineralogy, Institute the plants, not relative to where the plants are supposed of Physicochemical and Biological Problems of Soil to have been planted. Science, Russian Academy of Sciences, Pushchino, It is unfortunate that marketing of the system started Moscow Region, Russia when enthusiasm for GPS was reaching fever pitch and success has passed it by. Nevertheless research on vision Synonyms guidance is widespread (Gottschalk et al., 2008). Environmental magnetism; Soil magnetism Conclusions Definition As sensors and computing power become ever cheaper, Magnetic properties of soils are dominantly controlled by the opportunity for farm robotics increases. It would be the presence, volumetric abundance, and oxidation state of unwise to make a large machine autonomous, not least iron in soils. Different types of Fe oxides, Fe–Ti oxides, for insurance against the damage it might cause. Small and Fe sulfides are the predominant causes of magnetic robot machines, however, can already be equipped with soil characteristics. The concentration of magnetic Fe vision, navigation, detection and communication systems oxides in soils is affected by the parent material and soil- at a very modest price. We may very soon see teams of forming factors and processes. “Autonomous Robot Farmhands” at work in the field. Introduction Bibliography Magnetism is a fundamental property of all natural mate- rials. The most important kinds of magnetic properties are Åstrand, B., and Baerveldt, A.-J., 2002. An agricultural mobile those called diamagnetism, paramagnetism, ferromagne- robot with vision-based perception for mechanical weed control. Journal Autonomous Robots, 13(1), 21–35. tism, ferrimagnetism, and superparamagnetism. The mag- Billingsley, J., and Schoenfisch, M., 1996. The successful develop- netic properties of soils are a subject of investigation ment of a vision guidance system for agriculture. Computers and started first more than 50 years ago (Le Borgne, 1955). Electronics in Agriculture, 16(2), 147–163. Magnetism of soils have traditionally been investigated in Dunn, M., and Billingsley, J., 2007. The use of machine vision for the environmental science and geophysics communities to assessment of fodder quality. In Proceedings of the 14th Interna- indicate soil development, paleosols and climate change, tional Conference on Mechatronics and Machine Vision in Practice, Xiamen, PRC, 3–5 December 2007, pub IEE ISBN pollution, and as tools for archaeological mapping and 1-4224-1357-5, pp. 179–184. prospecting (Thompson and Oldfield, 1986;Maherand Gottschalk, R., Burgos-Artizzu, X. P., Ribeiro, A., Pajares, G., and Thompson, 1999; Evans and Heller, 2003;Maher,2008). Sainchez-Miralles, A., 2008. Real-time image processing for the guidance of a small agricultural field inspection vehicle. In Soil magnetics Proceedings Mechatronics and Machine Vision in Practice, 2008. pp. 493–498 The magnetic characteristics of soil and sediments reflect McCarthy, C. L., Hancock, N. H., and Raine, S. R., 2008. On-the-go the amount and quality of ferruginous minerals they con- machine vision sensing of cotton plant geometric parameters: tain and are connected with their content, mineralogy, first results.