High-Speed 3D Tracking of Swimming Cell
In the field of biology, there are many opportunities to use a microscope in order to observe microscopic objects. In general, the field of view and the focal range of microscopes is narrow. Therefore, when the moving object such as swimming cell is observed, the swimming cell moves not only to planar direction but also to depth direction of the microscope and it is difficult to keep the swimming cells under the microscope. To solve this problem, the high-speed 3D tracking for microscopic objects is demanded.
In order to execute the high-speed 3D tracking, it is necessary to rapidly acquire 3D information of the target object. As a way of acquiring 3D information, the focusing scanning which the focal position of the microscope is scanned in the direction of optical axis, is used in our study. In recent years, the tunable acoustic gradient index (TAG) lens which the focal length can be changed at high-speed (several tens to several hundreds kilo-hertz), was developed. Thus, the focus scanning can be executed at high-speed by using TAG lens. However, TAG lens cannot stop the vibration at a specific focal length. To acquire the specific focal position with TAG lens, a short-time exposure (about 1 us) must be executed only when the lens reaches a specific focal length.
In this study, the temporally coded exposure (TeCE) camera is developed in order to solve this problem. There are two features of TeCE camera as follows; 1) to execute multiple times short-time exposure in arbitrary timing, 2) to accumulate the photo-electrons generated by each short-time exposure. The high-speed 3D measurement can be achieved by synchronizing the TAG lens and TeCE camera. In our study, the high-speed 3D module which coupling TeCE camera with TAG lens was developed, and it was confirmed that 3D information of swimming cell (Chlamydomonas) can be acquired in 3 milliseconds. The high-speed 3D tracking of the cell was also achieved by controlling an automated XYZ-stage based on the acquired 3D information, as shown in the movie below. The stage continuously moved the container holding the specimen so that the target was always kept at the center of the volume of view of the microscope.
Fig. 1. Concept of the proposed microscope system.
Fig. 2. Prototype of high-speed 3D module
Movie the tracking result of Chlamydomonas and its principle
References
-
Kazuki Yamato, Hiroyuki Chiba, Hiromasa Oku : High Speed Three Dimensional Tracking of Swimming Cell by Synchronous Modulation between TeCE Camera and TAG Lens, IEEE Robotics and Automation Letters (2020) (to appear)
-
Kazuki Yamato, Toshihiko Yamashita, Hiroyuki Chiba and Hiromasa Oku : Fast Volumetric Feedback under Microscope by Temporally Coded Exposure Camera, Sensors, Vol.19, No.7, 1606 (2019) [doi:10.3390/s19071606]
-
Kazuki Yamato, Toshihiko Yamashita, Hiroyuki Chiba, Hiromasa Oku : Temporally Coded Exposure Camera for High-Speed Feedback of Microscopic 3D Information, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO 2018) (Kuala Lumpur Convention Centre, Kuala Lumpur, Malaysia, 2018.12.14) / Proceedings, pp.958-963
-
Toshihiko Yamashita, Hiroyuki Chiba, Kazuki Yamato, Hiromasa Oku : Development of a coded exposure camera for high-speed 3D measurememt using microscope, OSA Imaging and Applied Optics Congress (Wyndham Orlando Resort International Drive, Orlando, USA, 2018.06.26)/ITu3B.2