Fig. 4: Optical flow generation assisted by temporal cues. | Nature Communications

Fig. 4: Optical flow generation assisted by temporal cues.

From: Ultrafast visual perception beyond human capabilities enabled by motion analysis using synaptic transistors

Fig. 4: Optical flow generation assisted by temporal cues.The alternative text for this image may have been generated using AI.

a Algorithm structure for generating optical flow assisted by temporal cues. b Process of translating temporal information based on synapse array states into temporal motion cues. c Calculated temporal motion cues for vehicle and UAV operation scenarios. d Accelerated velocity inference using temporal cues. e Schematic diagram of different velocity inference algorithms, including Farneback, GMFlow, and RAFT. f Filtered visual input using temporal cues and resulted movement velocity. g Example results from the vehicle operation scenario. h Example results from the UAV operation scenario. i Comparison of velocity inference times between conventional and neuromorphic pipeline (using Farneback). j Average time comparison.

Back to article page