A one-pixel camera for recording holographic movies

(Press-News.org) A new camera setup can record three-dimensional movies with a single pixel. Moreover, the technique can obtain images outside the visible spectrum and even through tissues. The Kobe University development thus opens the door to holographic video microscopy.

Holograms are not only used as fun-to-look-at safety stickers on credit cards, electronic products or banknotes; they have scientific applications in sensors and in microscopy as well. Traditionally, holograms require a laser for recording, but more recently, techniques that can record holograms with ambient light or light emanating from a sample have been developed. There are two main techniques that can achieve this: one is called “FINCH” and uses a 2D image sensor that is fast enough to record movies, but is limited to visible light and an unobstructed view, while the other is called “OSH,” which uses a one-pixel sensor and can record through scattering media and with light outside the visual spectrum, but can only practically record images of motionless objects.

Kobe University applied optics researcher YONEDA Naru wanted to create a holographic recording technique that combines the best of both worlds. To tackle the speed-limiting weak point of OSH, he and his team constructed a setup that uses a high-speed “digital micromirror device” to project onto the object the patterns that are required for recording the hologram. “This device operates at 22 kHz, whereas previously used devices have a refresh rate of 60 Hz. This is a speed difference that’s equivalent to the difference between an old person taking a relaxed stroll and a Japanese bullet train,” Yoneda explains.

In the journal Optics Express, the Kobe University team now publish the results of their proof-of-concept experiments. They show that their setup can not only record 3D images of moving objects, but they could also construct a microscope that can record a holographic movie through a light-scattering object — a mouse skull to be precise.

Admittedly, the frame rate of just over one frame per second was still fairly low. But Yoneda and his team showed in calculations that they could in theory get that frame rate up to 30 Hz, which is a standard screen frame rate. This would be achieved through a compression technique called “sparse sampling,” which works by not recording every portion of the picture all the time.

So, where will we be able to see such a hologram? Yoneda says: “We expect this to be applied to minimally invasive, three-dimensional biological observation, because it can visualize objects moving behind a scattering medium. But there are still obstacles to overcome. We need to increase the number of sampling points, and also the image quality. For that, we are now trying to optimize the patterns we project onto the samples and to use deep-learning algorithms for transforming the raw data into an image.”

This research was funded by the Kawanishi Memorial ShinMaywa Education Foundation, the Japan Society for the Promotion of Science (grants 20H05886, 23K13680), the Agencia Estatal de Investigación (grant PID2022-142907OB-I00) and the European Regional Development Fund, and the Generalitat Valenciana (grant CIPROM/2023/44). It was conducted in collaboration with researchers from Universitat Jaume I.

Kobe University is a national university with roots dating back to the Kobe Higher Commercial School founded in 1902. It is now one of Japan’s leading comprehensive research universities with nearly 16,000 students and nearly 1,700 faculty in 11 faculties and schools and 15 graduate schools. Combining the social and natural sciences to cultivate leaders with an interdisciplinary perspective, Kobe University creates knowledge and fosters innovation to address society’s challenges.

END