A group of researchers has recently introduced a groundbreaking artificial compound eye system that is not only more affordable but also boasts a sensitivity level that is at least double that of current products available on the market, particularly in smaller areas. This advancement is set to transform robotic vision, improving robots’ capabilities in navigation, perception, and decision-making, and paving the way for more commercial applications as well as enhanced collaboration between humans and robots.
A research team at the School of Engineering of the Hong Kong University of Science and Technology (HKUST) has recently developed a novel artificial compound eye system that is not only more cost-effective, but demonstrates a sensitivity at least twice that of existing market products in small areas. The system promises to revolutionize robotic vision, enhance robots’ abilities in navigation, perception and decision-making, while promoting commercial application and further development in human-robot collaboration.
This innovative system imitates the visual abilities of compound eyes and can be utilized in a variety of situations, such as equipping drones to boost their precision and effectiveness in tasks like irrigation or emergency rescue operations in crisis situations. Thanks to its heightened sensitivity, this system also facilitates closer collaboration between robots and other connected devices. Over time, the compound eye system aims to improve the safety of autonomous driving and speed up the integration of intelligent transportation systems, fostering the development of smart cities.
The project was spearheaded by Prof. FAN Zhiyong, who holds the position of Chair Professor in both the Department of Electronic & Computer Engineering and the Department of Chemical & Biological Engineering at HKUST. This groundbreaking technology signifies a substantial advancement in biomimetic vision systems.
Historically, researchers in robotics have primarily concentrated on mimicking the visual systems of insects, which provide a broad field of view and advanced motion-tracking abilities. However, incorporating compound eye systems into autonomous platforms like robots or drones has been difficult due to challenges related to complexity, stability during changes in shape, geometric limitations, and potential discrepancies between the optical and detection components.
To tackle these issues, Prof. Fan’s team created a pinhole compound vision system employing new materials and innovative structures. This system boasts several important features, including a naturally hemispherical perovskite nanowire array imager with high pixel density to broaden the imaging field; and a 3D-printed, lens-free pinhole array with a customizable configuration to control the incoming light and remove any blind spots between adjacent ommatidia (the individual elements of an insect’s compound eye). Thanks to its excellent angular selectivity, expansive field of view, wide spectral response in both monocular and binocular setups, along with its capability for tracking dynamic motion, the pinhole compound eye can not only accurately identify targets but can also follow a moving quadruped robot when mounted on a drone.
Prof. Fan stated, “This compound eye design is straightforward, lightweight, and inexpensive. While it may not completely replace traditional cameras, it could greatly enhance specific robotics applications, such as in scenarios where a group of drones needs to fly in tight formation. By further reducing the size of the device and increasing the number of ommatidia, image resolution, and response speed, this type of device has the potential for widespread use in optoelectronics and robotics.”
As a prominent researcher in biomimetic optoelectronics, Prof. Fan aims to merge practical solutions with bold ideas to propel innovative research forward. This unique compound eye achievement represents yet another significant milestone in the realm of vision and robotic systems, following his creation of the world’s first spherical artificial eye with a 3D retina in 2020.
The results of this research have been published and highlighted as a cover article in the prestigious international journal Science Robotics. Co-first authors include Dr. ZHOU Yu (postdoc), Dr. SUN Zhibo (postdoc), and DING Yucheng (PhD student), with Prof. Fan serving as the corresponding author.
