Single-Cell Level Continuous Observation of Microorganism Galvanotaxis Using High-Speed Vision
Total Page:16
File Type:pdf, Size:1020Kb
SINGLE-CELL LEVEL CONTINUOUS OBSERVATION OF MICROORGANISM GALVANOTAXIS USING HIGH-SPEED VISION Naoko Ogawa∗, Hiromasa Oku†∗, Koichi Hashimoto∗† and Masatoshi Ishikawa∗ ∗Graduate School of Information Science and Technology, Univ. of Tokyo 7–3–1 Hongo, Bunkyo-ku, Tokyo 113–8656, Japan †PRESTO, Japan Science and Technology Agency 4–1–8 Honcho Kawaguchi, Saitama, Japan {Naoko Ogawa,Hiromasa Oku,Koichi Hashimoto,Masatoshi Ishikawa}@ipc.i.u-tokyo.ac.jp ABSTRACT Visual Feedback A novel system for measurement of motile microorgan- Object Bio-moduleio-modo-mod Bio-moduleo-mod Informationrmama Informationormarm Sensoreensns Information ism galvanotaxis using high-speed vision is presented. Our Informationrrmama Processing goal is to construct a smart microsystem composed of many System controlled microorganisms called “Organized Bio-Modules” Bio-modules (OBM). The OBM system utilizes galvanotaxis (intrinsic reaction to electrical stimulus) of microorganisms for ac- tuation. For evaluation of taxis, continuous observation of a moving single cell in a sufficiently large working area with- Control Instruction out fixation is needed. Using high-speed vision, we devel- oped a system for continuous evaluation of galvanotaxis of Fig. 1. Concept of Organized Bio-Modules. freely swimming cells in a large area at the single-cell level. Experimental results demonstrate the continuous measure- ment of galvanotaxis of a Paramecium caudatum cell mov- precise sensing. Since taxis of microorganisms exhibits sig- ing in a 3.5-mm-square area for 18 s with 1 µs precision. nificant individuality, identification of each cell and single- cell level observation are important. To be more precise, there are two requirements for measurement in the OBM 1. INTRODUCTION system: evaluation of the natural states of fast microbes Detection of changes in the surroundings and fast reaction without fixation in a sufficiently large working area, and against stimulus are matters of the greatest importance for single-cell level observation with high magnification for de- all living things. Thus microorganisms have acquired so- tailed evaluation of the individuality. However such require- phisticated sensors and actuators in their small bodies. If ments are difficult to satisfy in conventional micromanipu- we develop techniques to control microorganisms like mi- lation systems. cromachines, we can realize a multi-purpose programmable In this paper, we propose a system for continuously mea- micro system. In this study, we regard an individual mi- suring galvanotaxis of moving cells at the single-cell level croorganism as a “bio-module,” a functional unit. Our goal without limit on the working area. Our system makes use of is to integrate a number of bio-modules and computers to high-speed vision. construct an ”organized bio-modules” (OBM) system. The concept of OBM system is shown in Fig. 1. The OBM sys- tem has potential applications such as cell manipulation, mi- 2. RELATED WORKS croscopic delivery and smart microsensors. Actuation of bio-modules is a key technology for real- Tracking of microorganisms is one of the techniques that izing OBM. We focus on “taxis” of microorganisms, an in- many biologists have sought for, because it allows us to ob- trinsic locomotor response toward or away from an external serve the natural ecology of cells without fixation. Though stimulus. For example, many protozoa and bacteria exhibit many studies on tracking of microbes have been presented [1, taxis in response to electrical stimulus (galvanotaxis), which 2, 3, 4], most tracking systems could detect only a few fea- implies the possibility of controlling their motion by adjust- tures of the target, such as its position. Moreover, each sys- ing the electrical stimulus. tem was specially designed for a specific target, thus lacking In order to establish a method for controlling bio-modules, versatility. As discussed later, our system has an advantage the taxis must be evaluated. Imaging techniques are essen- in that it is versatile and able to extract various features in tial tools for this, due to their noninvasive, non-contact, and real-time, which is necessary for OBM. 0-7803-8388-5/04/$20.00 ©2004 IEEE 1331 Image input 3. GALVANOTAXIS MEASUREMENT SYSTEM Cycle time : 1ms 3.1. Necessity for High-Speed Vision 8bit Column PD array ADC parallel PE array 128 x 128 image 128 x 128 Image 128 One major problem in microscope tracking is the trade-off transfer Intensifier pixels PEs between magnification and trackability; as the magnifica- Summation Image tion increases, it becomes more difficult to track the target circuit Control Column feature signals Instructions parallel extraction continuously. When the frame rate of the vision system is data inout to host low, it is difficult to ensure both magnification and tracka- Controller PC bility. This can be written as NM = f/a, (const.) Fig. 2. Block diagram of I-CPV system. where N is the trackability (the number of frames for the target to cross over the visual field), M the magnification Features (ratio of the target length to the visual field width), f the RTOS PC I-CPV a Tracks a moving frame rate of the vision system, and the target speed (di- microorganism I-CPV so as to keep ameters/sec). This implies that certain qualities for both it on the center Image magnification and trackability (i.e. sufficiently large M and N) is not ensured by an insufficient frame rate, when the Microscope XY-Stage Torque X Instruction target moves fast (i.e. a is large). Electrodes Slide Glass Y Most bacteria can swim as fast as 50 diameters/sec [1]. Actuator Position Thus, for conventional vision systems with 30 Hz frame Specimen XY Stage rate, we can estimate the value of NM to be 0.6, which is Voltage too small for our stated goal, namely compatibility of mag- Fig. 3. System configuration. nification and trackability. For this reason, we use a high- speed vision system with 1 kHz frame rate, so that NM can be over 20, which is enough for our purposes. cells swimming in a chamber on an electrical stimulus input 3.2. High-Speed Vision System: I-CPV device mounted on an XY stage. The stage is controlled by the I-CPV system so as to keep a cell on the center of the In order not to lose the target with high magnification, a view. By reading encoders of the stage, the position of the high frame rate is required for the vision system. Moreover, cell is obtained. The posture of the cell is also calculated an observing method with weak light, such as dark field mi- from image features. croscopy, is needed, to prevent heat and light influence on In the system proposed here, the I-CPV system is mounted the cells. on an upright optical microscope (Olympus, BX50WI) and To obtain dark images very quickly, we adopted an I- captures dark-field images. From the captured images, it CPV system (Hamamatsu Photonics), which is a Column calculates image features such as summation and moments, Parallel Vision (CPV) system with an image intensifier [5]. and sends them to the PC within 1ms. These features are CPV is a high-speed vision system developed for robotic used for visual feedback control of the XY stage. use [6]. A block diagram of the I-CPV is depicted in Fig 2. It captures and processes an 8-bit gray-scale image with The PC controls the position of a chamber fixed on the 128×128 pixels and 1 kHz frame rate. I-CPV has a 128×128 XY stage. The XY stage (SMC, LAL00-X070) has two or- photo detector (PD) array and the same number of programmable thogonal axes, X and Y, whose stroke is 25 mm. Each axis µ processing elements (PEs). The captured image is amplified has an encoder with 1 m precision. Tracking is achieved several thousand times by the image intensifier and trans- by controlling the stage according to the extracted target po- mitted to the PEs in a column-parallel manner. Each PE is sition. based on the S3PE architecture [7], which adopts a SIMD type program control. I-CPV can process image data com- PC Stimulus Voltage Electrodes pletely in parallel. Each PE is connected with a summa- Controller D/A Global Torque Stage Stimulus tion circuit, so that it can execute various processes, such as Desired Position Instruction Movement Feature Coordinate Servo Actuator Object global image feature extraction, edge extraction, embossing Transformation Controller D/A Centriod Actuator Enc.Cnt. Image and blurring within 1ms [6]. Position PIO Features of I-CPV 3.3. System Configuration Memory the Image Figures 3 and 4 show the configuration and block diagram of the overall system. An electric stimulus is applied on Fig. 4. Block diagram for tracking and measurement. 1332 cover glass glass slide chamberc r electrodes 0.0s 0.3s Fig. 5. Electrical stimulus input device. Y image coordinate system x G x O 0.1s 0.4s Ys Y θ yG n pixels 0.2s 0.5s y X O X Xs Fig. 7. Sequential photographs of a cell making a U-turn by global coordinate system stimulus reversal (0.1 s interval). Fig. 6. Relationship between two coordinate systems. where p is the pixel pitch, n the number of pixels on an edge m Figure 5 shows the electrical stimulus input device. Two of the visual field, and is the magnification. The minus carbon electrodes of 0.5 mm diameter are placed in parallel sign is due to the reversed visual field of the microscope 22 mm apart on a glass slide, in order to control the electri- image. Thus the trajectory and the orientation of the target cal stimulus in one direction perpendicular to the electrodes. are reconstructed every 1ms.