A Visual Inertia‐Inspired Multimode Sensor Based on Pb–S Strongly Coupled Heterostructures for Information Fusion Positioning and Monitoring

Abstract

ABSTRACT The visual‐inertial odometry (VIO) system enables continuous and accurate tracking of high‐speed moving objects, offering distinct advantages for unmanned vehicles and mobile robots, but spatiotemporal inconsistency between components data often degrades overall performance. Here, we demonstrate a visual inertia‐inspired multimode sensor (VIMS) based on FAPbI 3 (FA/PbI 2 = 4:1) organic–inorganic hybrid perovskite quantum dots (OIHPQDs) sensitized MoS 2 heterostructure, featuring reconfigurable photodetector (PD) and photosynaptic (PS) functions, successfully demonstrating single‐device functional integration for VIO. The heterostructure exhibits light‐power‐selective, Pb–S coupled‐mediated charge transport, enabling distinct light response speeds for PD and PS mode switching while overcoming the need for lattice matching in heterostructure coupling. Moreover, uniform‐sized FAPbI 3 is obtained using a self‐designed microfluidic technique, ensuring excellent reproducibility in the fabricated heterointerface. The developed devices exhibit a high specific detectivity ( D * ) gain of ≈ 1000 under 0.039 mW/cm 2 dim light, excellent synaptic plasticity with 90% recognition accuracy and 40% noise tolerance, and optical secure communication capability with response times over 10 times faster than in PS mode. More importantly, the dual‐mode VIMS array enables real‐time tracking of dynamic grayscale and static attitude information from high‐speed Newton's cradle and billiards, demonstrating dynamic/static information fusion for positioning and monitoring.