Arxiv:2107.11450V1 [Physics.Optics] 23 Jul 2021 Achieve in Any Other Such Minimally Invasive Way
Total Page:16
File Type:pdf, Size:1020Kb
Time of flight 3D imaging through multimode optical fibres Daan Stellinga,1, ∗ David B. Phillips,2, ∗ Simon Peter Mekhail,1, ∗ Adam Selyem,3 Sergey Turtaev,4 Tom´aˇs Ciˇzm´ar,ˇ 4, 5 and Miles J. Padgett1, y 1School of Physics and Astronomy, University of Glasgow, G12 8QQ, UK. 2School of Physics and Astronomy, University of Exeter, Exeter, EX4 4QL. UK. 3Fraunhofer Centre for Applied Photonics, G1 1RD, Glasgow, UK. 4Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, 07745 Jena, Germany. 5Institute of Scientific Instruments of the CAS, Kr´alovopolsk´a147, 612 64 Brno, Czech Republic. Time-of-flight (ToF) 3D imaging has a wealth of applications, from industrial inspec- tion to movement tracking and gesture recognition. Depth information is recovered by measuring the round-trip flight time of laser pulses, which usually requires projection and collection optics with diameters of several centimetres. In this work we shrink this requirement by two orders of magnitude, and demonstrate near video-rate 3D imag- ing through multimode optical fibres (MMFs) - the width of a strand of human hair. Unlike conventional imaging systems, MMFs exhibit exceptionally complex light trans- port resembling that of a highly scattering medium. To overcome this complication, we implement high-speed aberration correction using wavefront shaping synchronised with a pulsed laser source, enabling random-access scanning of the scene at a rate of ∼23,000 points per second. Using non-ballistic light we image moving objects several metres beyond the end of a ∼40 cm long MMF of 50 µm core diameter, with millimetric depth resolution, at frame-rates of ∼ 5Hz. Our work extends far-field depth resolving capabilities to ultra-thin micro-endoscopes, and will have a broad range of applications to clinical and remote inspection scenarios. Introduction. Multimode optical fibres (MMFs) repre- fixed configuration, the scrambling process is determinis- sent an extremely efficient method of transporting light tic and unchanging in nature, and so a given input field with a high spatial information density. They can sup- will always produce the same output field. This means port the propagation of thousands of spatial modes - that the way a static MMF scrambles light can be repre- i.e. optical field patterns which act as independent in- sented by a linear matrix operator, known as a transmis- formation channels - within a cross-sectional area sim- sion matrix (TM), which maps any possible input field ilar to that of a human hair. These features have led to the resulting output [9{15]. to much interest in the deployment of MMFs as micro- Measurement of the TM enables calculation of how an endoscopes, enabling high-resolution imaging at the tip input field should be pre-shaped to generate a desired of a needle [1{5]. In this work we investigate the feasi- output, for example a spot focused to a particular loca- bility of enhancing MMF-based imaging to include depth tion. This method is known as wavefront shaping [16, 17], information. Extending 3D imaging capabilities through and thus by illuminating the proximal facet with a se- ultra-thin MMFs promises an array of new applications, quence of carefully prepared input light fields, a focused including the 3D inspection of the internal chambers of spot can be raster scanned across the distal facet of a objects that are difficult to open, such as jet engines or MMF. Scanning-based imaging can then be achieved by nuclear reactors, and the 3D visualisation of hollow vis- recording the total intensity of light returning through cous organs, which could help surgeons navigate inside the fibre and correlating this with the position of the the body during operations. focus [18, 19]. Recently wavefront shaping through MMFs has been However, the compact form of MMFs comes at a employed for in-vivo imaging of neurons deep inside the cost: monochromatic optical signals are subject to modal brains of mice [2{4] - an endeavour very challenging to dispersion, as the phase velocity of light propagating arXiv:2107.11450v1 [physics.optics] 23 Jul 2021 achieve in any other such minimally invasive way. Imag- through a MMF depends upon its spatial mode. There- ing of objects some distance from the distal facet of a fore input coherent light patterns are typically unrecog- MMF is also possible [11, 20]. However, this is more de- nisably scrambled into speckle patterns at the output manding, since the level of return signal falls off rapidly facet, formed entirely from non-ballistic light that has in proportion to the square of the objects's distance. scattered multiple times from the core-cladding inter- Here we augment MMF micro-endoscopy with time- face [6{8]. Fortunately, as long as a MMF remains in a of-flight (ToF) LiDAR (Light Detection And Ranging) techniques, to provide depth information alongside 2D reflectance images [21{23]. ToF techniques recover depth ∗These authors contributed equally to this work by measuring the round-trip flight time of a laser pulse yElectronic address: [email protected]. reflecting from the scene. To achieve this we implement 2 Holographic Endoscope (Spatial/Lateral Resolution) (a) DMD Illumination Collection Multimode Fib re PD APD Pulsed Laser BS Reference Signal Time of Flight (Temporal/Axial Resolution) (b) (c) t = 0s t = 2s t = 4s t = 6s 40 Depth (cm) Depth 25 Direct camera image Frame 0 Frame 10 Frame 20 Frame 30 FIG. 1: Endoscopic LiDAR. (a) A schematic of the experimental set-up. (b) A snapshot of the true scene being recorded. (c) Typical depth-resolved images obtained with the our system. Each frame is captured in 200 ms. The frames show the pieces on a revolving chess board located at a depth of ∼30 cm, recorded at a frame rate of 5Hz. The dark spots in images are due to singularities in the speckle reference used to measure the TM. high-speed wavefront shaping of a sub-ns pulsed laser Spatial mode dispersion can be understood by consid- source. We measure the TM linking the proximal ering that an incident pulse will excite different spatial end of a MMF to the far-field of the distal facet, and modes supported by the fibre, which travel at slightly calculate the input fields required to raster scan a different velocities [24{26]. A MMF acts as a multi-path focused spot across the far-field scene. A second MMF interferometer with many different arms - about 1000 collects the back-scattered light, which is coupled to a in our case. Once the optical path difference between fast photo-detector, enabling measurement of both the these arms, ∆OPL, is greater than the coherence length reflectivity and the time-of-flight at each spot location. of the pulse, `p, light in these respective spatial modes no The two MMFs therefore act as an endoscopic LiDAR longer interferes, and the visibility of the output interfer- system with highly compact projection optics of ∼600 ence pattern reduces. In the extreme this leads to severe microns in diameter - roughly two orders of magnitude temporal pulse distortion - whereby a single input pulse smaller than conventional LiDAR based topographic fragments into separate pulses propagating in different imaging systems. Our endoscope can deliver depth spatial modes that exit the fibre in sequence and so are resolved images of macroscopic scenes up to 2.5 m away unable to interfere with one another [27]. In this case from the fibre facets with an imaging frame-rate up to wavefront shaping, which relies on controlling the inter- 5 Hz. Figure 1 shows a schematic of our setup and some ference of different spatial modes at the output, is not example images, each recorded in 200 ms - here identi- possible without spatio-temporal compensation [28, 29]. fying the relative depths of chess pieces on a revolving To avoid the added complexity of spatio-temporal beam chess board positioned ∼30 cm from the distal fibre facet. shaping, we must ensure that `p >> ∆OPL. This in turn places constraints on the temporal length of the pulse Results. Extending wavefront shaping through MMFs τp that can be used with a given geometry of the fibre, from continuous-wave to pulsed illumination presents an leading to (see Supplementary for derivation): additional complication: the potential for temporal pulse distortion due to chromatic or spatial mode dispersion. NA2L τp >> : (1) In our system the latter form of dispersion dominates. cnc 3 where L is the (single pass) fibre length, NA is the numer- During the recording of ToF images, a second fibre is ical aperture of the fibre, nc is the refractive index of the used to collect the backscattered light, placed alongside core, and c is the speed of light in a vacuum. Here we use the illumination fibre. Both fibres have the same NA of a fibre of L ∼ 0:4 m, NA = 0:22, and nc = 1:45, meaning 0.22, however the collection fibre has a larger core diam- τp should be significantly longer than ∼45 ps. To ensure eter of 500 µm to increase the collection efficiency and minimal pulse distortion, we choose a laser with a pulse thereby the working distance of the endoscope. The al- duration of τp ∼700 ps, i.e. a factor of ∼15× longer than ternative approach of conducting both illumination and the limit set by Eqn. 1. detection through a single fibre is challenging due to re- The number of independently resolvable features in im- flections and scattering at both fibre facets. The small ages that can be transmitted through a MMF is propor- size of the collection aperture means that only in the or- tional to the number of spatial modes, N, it supports per der of 1 in 1010 backscattered photons will be reflected polarisation degree of freedom.