A Visual Inertia-Inspired Multimode Sensor Based on Pb–S Strongly Coupled Heterostructures for Information Fusion Positioning and Monitoring

The visual-inertial odometry (VIO) system enables continuous and accurate tracking of high-speed moving objects, offering distinct advantages for unmanned vehicles and mobile robots, but spatiotemporal inconsistency between components data often degrades overall performance. Here, we demonstrate a visual inertia-inspired multimode sensor (VIMS) based on FAPbI 3 (FA/PbI 2 = 4:1) organic–inorganic hybrid perovskite quantum dots (OIHPQDs) sensitized MoS 2 heterostructure, featuring reconfigurable photodetector (PD) and photosynaptic (PS) functions, successfully demonstrating single-device functional integration for VIO. The heterostructure exhibits light-power-selective, Pb–S coupled-mediated charge transport, enabling distinct light response speeds for PD and PS mode switching while overcoming the need for lattice matching in heterostructure coupling. Moreover, uniform-sized FAPbI 3 is obtained using a self-designed microfluidic technique, ensuring excellent reproducibility in the fabricated heterointerface. The developed devices exhibit a high specific detectivity ( D * ) gain of ≈ 1000 under 0.039 mW/cm 2 dim light, excellent synaptic plasticity with 90% recognition accuracy and 40% noise tolerance, and optical secure communication capability with response times over 10 times faster than in PS mode. More importantly, the dual-mode VIMS array enables real-time tracking of dynamic grayscale and static attitude information from high-speed Newton's cradle and billiards, demonstrating dynamic/static information fusion for positioning and monitoring.