<<

Real Time Volumetric lmaging System

Olaf T. von Ramm and Stephen W. Smith

A real time volumetric ultrasound system and extensive operator interaction that preclude has been developed for . The scan- imaging of dynamic structures without sophisti- ner produces images analogous to ah optical camera cated gating techniques. and supplies more information than conventional sonograms. Potential medical applications include In the field of diagnostic ultrasound, 3D imag- improved anatomic visualization, tumor tocalization, ings systems have been proposed in the past. and better assessment of cardiac function. The However, these have been too slow for clinical system uses pulsa-echo principias to applications 4'5 or have operated primarily in a steer a two-dimensional erray trensducer of 289 through-transmission mode requiring a complex elements in a pyramidal sean format. Parallel process- ing in the receive moda produces 4992 scan lines eta water-path apparatus. 6'70ur objective was to rata of approximately 8 frames/second. Echo data develop ah ultrasound system, which uses a for the scanned volume is presented es projection hand-held transducer, capable of scanning a images with depth perspectiva, steraoscopic pairs, volume rapidly and enabling the 3-D visualiza- multiple tomographic images, or C-moda scans. tion of dynamic structures in real time. 9 1990 by W.B. Saunders Company. In order to extend cross-sectional ultrasound KEY WORDS: diagnostic ultrasound, phased array. imaging to volumetric imaging, three advances three-dimensional, volumetric, diagnostic imaging, were necessary: (1) a hand-held transducer was real time. needed that could be steered rapidly and focused at ~.ny desired orientation in the volume; (2) the A HIGH-SPEED volumetric ultrasound imag- data acquisition rate had to be increased signifi- ing system that uses pulse-echo principles cantly to obtain image data from many planes in analogous to sonar and has been developed real time; (3) a display method was required, for medical application. Conventional ultrasound which allowed the visualization of all or part of cross-sectional imaging has become a valuable the echo data obtained from the scanned diagnostic modality in virtually every medical volume. speciality. ] In routine clinical practice, ultra- In order to demonstrate expeditiously the fea- pulse-echo images of are ob- sibility of high-speed volumetric ultrasound imag- tained with high spatial resolution (1 to 2 mm), ing, the extant Duke University phased array at real time, vŸ frame rates (30/sec) using research scanner 8 was appropriately modified. portable systems. Currently, the most sophisti- Figure 1 illustrates the concept of a volumetric cated scanners use a phased phased array ultrasound imaging system that linear array of approximately 100 piezoelectric uses a two-dimensional (2D) array of transducer transducer elements to steer and focus the ultra- r to produce a pyramidal scan composed sonic beam along approximately 150 directions of eight steering directions in the azimuth dimen- in a sector sean format. Beam steering and sion, O, by 16 steering directions in the elevation focusing is accomplished by properly delaying dimension, ~. the transmit pulses and the echoes returning to the transducer array from tissue structures within the body. ~ From the Department of Biomedical Engineering, Duke Over the years, there has been interest in the University, Durham, NC; the Centerfor Devices and Radio- community in constructing logical Health, Food & Drug Administration, Rockville. three-dimensional (3D) rendcrings from serial MD; and the Department of , Duke University, cross-sectional images obtained via magnetic Durham, NC. Supported in part by Health and Human Sciences Grant resonance imaging, x-ray computed No. NCI CA37586, National Science Foundation/Engineer- and diagnostic ultrasound. 3 The advantages of ing Research Center Grant No. CDR-86222, and by the Food such renderings include more realistic anatomic and Drug Administration. visualization and improved localization and siz- Address reprint requests to Olaf T. von Ramm, Depart- ment of Biomedical Engineering, Duke University, Durham, ing of mass lesions for surgical procedures. Cur- NC 27706. rent techniques are limited by lengthy data 9 1990 by W.B. SaundersCompany. acquisition times, computer processing times, 0897-t 889/90/0304-0002503.00/0

Journa/ofDigita//maging, Vol 3, No 4 (November), 1990: pp 261=266 261 262 VON RAMM AND SMITH

Fig 1. Pyramidal sean for- mar of 3D ultresound imeging system showing 2D phesed ar- rey trensducer, and the trans- mit and receive elements within the arrey. Trensmit directions sre indicated by dotted lines. receive directions by dashes. Dots st end of scan volume ate "/~_~\.~~~/,.: :: .': .~/ image points used to produce the perspective display of Fig 3. Adjustable C-scan plane is indi- cated by darkened region,

In order to obtain best image quality, aU of the by the velocity of sound in tissue, ~-1540 m/sec. 17 x 17 elements of the array should be used. The data acquisition was increased through par- However, the Duke system is limited to 32 allel signal processing in the receive ruede in independent .transmit channels and 32 indepen- which eight steering directions were obtained dent receive channels. In this study, the Mills simultaneously for each transmitted ultrasound cross antenna design of radio astronomy9 was pulse. chosen for the transmit aperture (shown by the This parallel processing technique, which we solid cross in Fig 1) and ah independent Mills have described previously, I~ is illustrated in Fig 1 cross for the receive transducer aperture (shown for a few representative lines. In the 9direction, by the shaded diamonds of Fig 1) to provide the orientation of the two transmit pulses T 1 and adequate sampling of the 2D array. The two T 2 (produced by the transmit array) are shown crosses are positioned at 450 with respect to each by the dotted lines. By using the smaller transmit other and neither one utilizes the center element. cross array, the transmit beato is broadened to a This design enabted the imaging system to be width of =6 o. On each side of each transmit steered and focused to any desired angle with a beam, four receive mode scan lines spaced at 0.5 ~ small number of phased array channels while increments (shown by the dashed lines) are maintaining adequate spatial resolution for high- obtained in parallel by the receive mode array. contrast targets. The tradeoff associated with The steering directions are shown on an exagger- this transducer design increases the undesired ated scale in the figure. off-axis energy from the transducer. The receive mode parallel processing is accom- The 2D array of 289 transducer elements plished by the addition of smail independent illustrated in Fig 1 was fabricated in our labora- tapped delay lines to the principle electronic tory with independent transmit and receive crosses delay lines used for steering and focusing. These of 32 elements each. ]'he array operates at 1.7 small delays add the desired steering angle incre- MHz with inter-element spacing of 0.64 mm ment in the receive mode of the phased array yielding a spatial resolution of =4 o. The phased system. The eight to one parailel processing array time delays were calculated using the increases the data acquisition rate of the echo Pythagorean theorem for each transducer array signals by a factor of eight. Thus, in the volumet- etement at each transmit and receive focal point ric scanner 12 transmitted pulses steered in the for each line in the pyramidal sean. elevation (,I,) direction over a 65 ~ sector produce Conventional pulse-echo data acquisition is 96 steer… directions. In the azimuth direction limited by the round trip propagation time of ah (0), no parailel processing is currently imple- ultrasound pulse into the body that is determined mented, so that 52 transmit pulses yield 52 scan REAL TIME VOLUMETRIC ULTRASOUND IMAGING SYSTEM 263 lines steered over a 65 ~ sector. Thus, in each image. Since the echo data is written on the pyramidal sean, 624 transmit pulses produced screen continuously, the viewer's eye integrates 4992 scan lines per image at a frame rate of 8 the data to a single brightness value. This tech- images/second. As a trade-off, the broadened nique is illustrated in Fig 1 in which the 8 • 16 transmit beam, necessary for the increased data scan directions are represented by a matrix of acquisition rate of parallel processing, increases 8 x 16 dots. In this way, the ultrasound scanner undesired off-axis energy from the transducer produces a projection image and functions as the and degrades the image contrast by =13 dB in direct analogue of a normal optical camera. The the resulting 3D images. (x, y) of each point in the display is Figure 2 is a block diagram of the high-speed proportional to the tangent of the steering angle volumetric ultrasound phased array scanner. The of the corresponding sean line (tan O, tan ~). In figure shows the PDP-11 computer that serves as this display, a more distant object that subtends a the imaging system controller and provides the smaller angle within the pyramidal sean is dis- phased array delay data to the rest of the played as a smaller image. Thus depth is encoded imaging system. Also shown are the 32 transmit in the display as in the ora conven- pulsers that ¡ the transmit transducer array tional optical camera. and the 32 preampli¡ that amplify the ultra- Figure 3 shows preliminary results of our 3D sonic echoes from the receive mode array. The imaging system in water tank evaluations of the figure also shows the electronic delay lines that projection display. Figure 3 A is a 4992-1ine provide the receive mode delays for steering and pyramidal sean of a 14 mm (9/16 in) wrench in focusing as well as providing the 8 to 1 receive water positioned parallel to the transducer face mode parallel processing. Finally, the figure at a depth of 4 cm. Figure 3 B and C illustrate the shows the processing system and CRT effect of perspective as the wrench is moved to 6 scope for the display of the ultrasound images. and 9 cm, respectively, from the face of the For viewing the ultrasound images, ah optical transducer. holographic display II or 3D vibrating mirror 12 An interesting feature of all ultrasound scan- Would be desirable, but these are not currently ning is the ability to suppress unwanted image available as on-line, real time devices. We have data simply by gating the receive information or implemented two different display techniques varying the receive gain. 13 In this way, overlying using a conventional 2D cathode-ray tube screen. structures can be peeled away in the projection In the first method, all the echo data along each display to create the so called C sean. Such a scan line is displayed asa unique point in the range gated image from an object is illustrated in

132 Channels [ Preampllfle_____~rj ~

~ I~I Transmit ] ~ ] / Pulser 132 Channels .L

Paralleli Processing Delays -!" '

X/Y 8 Parallel Control Recelve Unes r Deflection ~ Master Generators Timlng ~~x.~Deflection I Vldeo "rv Sync Procelsing o~ CRT & Switchlng Fig 2. Block diagram of high-spoed 3D imaging system. Intensity 264 VON RAMM AND SMITH

A B C

Fig 3. (A) Projection image with perspective of a wrenr at a depth of 4 cm in water obtained with parallel processing and 4992 scan lines at 8 frames/second. (B) Image of same wrench at depth of 6 cm. (C) Wrench at 9 cm.

Fig 1 by the shaded slice parallel to the trans- ducer face. C scans that commonly require many seconds per image frame 14'15 can now be obtained at rates of 8 frames per second. In the second display method, all of the echo o data along each scan line is displayed by its projection on a plane passing through the apex of the pyramid. Viewed from the apex of the pyra- midal scan, the image lines appear to radiate in all directions from a common origin. Lines steered at small angles are viewed as points, while lines at large steering angles are viewed along their 9 A 9 entire length. The object can also be viewed from X any chosen direction by simply projecting echo information into a plane orthogonal to that view direction. Since all the 3D echo data is available

I i

Fig 4. Stereoscopic pairs are produced simultaneously by viewing two planar projections separated by 7 ~ of Fig 5. Optical photograph of cylindrical metal cage objects within the pyramidal volume. placed in scan volume. REAL TIME VOLUMETRIC ULTRASOUND IMAGING SYSTEM 265

A

Fig 6. (A) Left eye view of 3D ultra$ound projer imege of metal cage of Fig 5. (B) Right eye view of ultrasound projer tion image of metal r of Fig 5. independent of the display method, the pyrami- nature of the object is clearly visible. It should be dal scan can actually be displayed and viewed emphasized that the stereoscopic images are not from two directions simultaneously. This then computer reconstructed images. permits the display of simultaneous stereoscopic We have demonstrated the feasibility of on pairs. This display technique is illustrated in Fig line, high speed imaging. Further 4 in which the apex of the pyramidal scan is improvements in image quality are still needed centered between the two eyes of an observer. before clinical trials can determine the bene¡ of The image presented to each eye is the projection this new diagnostic technique. Phased array of echo data into planes rotated _+3.5 ~ about the x systems exceeding 200 independent transducer axis. channels may be necessary to produce high- In a preliminary study, we have implemented quality images of low-contrast structures such as such a stereoscopic display with the volumetric tissue parenchyma. Parallel processing certainly ultrasound scanner. A 65 ~ pyramidal scan com- needs to be implemented in both steering dimen- posed of 576 lines (24 x 24) was obtained with- sions, 0 and ~, to increase data acquisition rates out parallel processing at a frame rate of approx- by as muchas a factor of 100 over conventional imately 8 frames per second. The scan was rates. These advances are achievable with cur- displayed on-line as viewed in coordinate systems rent technology, especially with the development rotated + 3.5 ~ and -3.5 ~ about the x-axis. These of customized large-scale integrated circuitry. 16 images are equivalent to those viewed by the left Of equal importance is the further development and right eyes respectively in Fig 4. A cylindrical of 3D display technology and studies of the metal cage (4.4 cm x 8.9 cm), shown in an human perception of 3D information. With these optical photograph in Fig 5, was scanned perpen- improvements, 3D real-time ultrasound images dicular to its long axis. The left eye view and may then be a medical advance equivalent to the right eye view are shown in Figs 6 A and B, step from the one-dimensional ultrasound graphs respectively. When these images are fused by the of the 1950s to today's sonograms and will permit observer, asa stereoscopic pair by viewing the 3D ultrasound imaging of moving organs such as images with the corresponding eyes, the 3D the .

REFERENCES 1. Popp RL, Ma•ovski A: Ultrasonic diagnostic instru- dimensional and stereoscopic observation of body structures ments. Science 210:268-273, 1980 by ultrasound. J Appl Physiol 9:304-306, 1956 2. ron Ramm OT, Smith SW: Beato steering with linear 5. Brown TG: Visualization of soft tissues in two and three arrays. IEEE Transaction Biomed Eng BME 30:438-452, dimensions--limitationsand development. Ultrasonics 5:118- 1983 124, 1967 3. McCann HA, McCann JC, Harp S, et al: Multidimen- 6. Thurstone FL: Proceedings of symposium on biomedi- sional ultrasonic imaging for . Proceedings IEEE, cal •ngineering, in Mr AF, et al (eds) Acoustical 76:1063-1073, 1988 Holography rol 1. New York, NY, Plenum, 1969 4. Howry DH, Posakony G J, Cushman CR, et al: Three- 7. PS, Schaefer LF, Macovski A: Considerations 266 VON RAMM AND SMITH for diagnostic ultrasonic imaging, in Wade G (ed) Acoustical 12. Fuchs H, Pizer SM, Heinz ER, et al: Adding a true Holography (vol 4). New York, NY, Plenum, 1972, pp 3-D display to a rastr graphic system. IEEE Transcripts. 97-111 Computer Graphics and Applications 2:73-78, 1982 8. von Ramm OT, Thurstone FL: Cardiae imaging using a 13. WeUs PNT: Biomedical Ultrasonics. New York, NY, phased array ultrasound system I: System design. Circulation Academic, 147-148, 1977 53:258, 1975 14. McReady VR, Hill CR: A Constant Depth Ultrasonic 9. Steinberg BD: Principles of Aperture and Array Sys- Scanner. Brit J Rad 44:747-750, 1971 rem Design. Wiley Sons, New York, NY, 1976 10. Shattuck DP, Weinshr162 MD, Smith SW, et al: 15. Northved A, Holm HH, Kristensen JK, et al: An Explososcan: A parallel processing technique for high-speed ultrasonic spherical section scanner. Ultra Med Biol 1:183- ultrasound imaging with linear phased arrays. J Acoust Soc 186, 1974 Amer 75:1273-1282, 1984 16. O'Donnell M: Applieations of VLSI circuits to medi- 11. Baum G, GW: Optical holographic three- cal imaging. Proceedings of the lnstitute of Electrical and dimensional ultrasonography. Sciencr 189:994-995, 1975 Electronie Engineers 76:1106-114, 1988