Interspecies-chimera machine vision with polarimetry for real-time navigation and anti-glare pattern recognition

Abstract Cutting-edge humanoid machine vision merely mimics human systems and lacks polarimetric functionalities that convey the information of navigation and authentic images. Interspecies-chimera vision reserving multiple hosts’ capacities will lead to advanced machine vision. However, implementing the visual functions of multiple species (human and non-human) in one optoelectronic device is still elusive. Here, we develop an optically-controlled polarimetry memtransistor based on a van der Waals heterostructure (ReS2/GeSe2). The device provides polarization sensitivity, nonvolatility, and positive/negative photoconductance simultaneously. The polarimetric measurement can identify celestial polarizations for real-time navigation like a honeybee. Meanwhile, cognitive tasks can be completed like a human by sensing, memory, and synaptic functions. Particularly, the anti-glare recognition with polarimetry saves an order of magnitude energy compared to the traditional humanoid counterpart. This technique promotes the concept of interspecies-chimera visual systems that will leverage the advances of autonomous vehicles, medical diagnoses, intelligent robotics, etc.