Multi-Object Tracking in Computer Vision Systems
Summary
Multi-object tracking (MOT) lies at the heart of dynamic scene understanding in computer vision, with applications spanning autonomous vehicles, video surveillance, sports analytics and robotics. The prevailing paradigm, tracking-by-detection, decouples object localisation from the association of detections across frames. A key challenge is data association: matching newly detected object instances to existing tracks in the presence of missed detections, false positives and occlusions. Modern approaches fuse motion and appearance cues, often employing deep learning to extract robust feature embeddings. Short trajectories, or tracklets, serve as building blocks for long-term tracking but must be linked despite occlusions and identity switches. Evaluation relies on standardised benchmarks and metrics that balance detection accuracy, localisation precision and association consistency. Recent advances aim to improve scalability to crowded environments, extend to multi-view and 3D settings, and enhance real-time performance on edge devices. Global interest remains high due to the practical importance of reliable tracking in safety-critical systems and large-scale video analytics.
Research from Nature Portfolio
No recent Nature Portfolio content available.
Multi-Object Tracking in Computer Vision Systems publication trend
The graph below shows the total number of articles in multi-object tracking in computer vision systems across all publications each year (not limited to Nature Index journals).
Technical terms
Tracking-by-detection: Paradigm that first detects objects in each frame and then links detections into trajectories.
Data association: Process of matching new detections to existing tracks based on motion and appearance cues.
Tracklet: A short segment of a trajectory used for grouping consecutive detections of the same object.
Occlusion: Situation where an object is partially or fully blocked from view, complicating identity maintenance.
Benchmark: A standard dataset and evaluation protocol for comparing algorithm performance.
References
- HOTA: A Higher Order Metric for Evaluating Multi-object Tracking. International Journal of Computer Vision (2020).
- MOTChallenge: A Benchmark for Single-Camera Multiple Target Tracking. International Journal of Computer Vision (2020).
- Long-Term Tracking With Deep Tracklet Association. IEEE Transactions on Image Processing (2020).
- Hybrid Motion Model for Multiple Object Tracking in Mobile Devices. IEEE Internet of Things Journal (2022).
- A Bayesian Filter for Multi-View 3D Multi-Object Tracking With Occlusion Handling. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
- SimpleTrack: Rethinking and Improving the JDE Approach for Multi-Object Tracking. Sensors (2022).
About these summaries
This Nature Research Intelligence Topic summary is created with the cited references and a large language model. We take care to ground generated text with facts, and have systems in place to gain human feedback on the overall quality of the process in line with our AI principles. We strive to create accurate and useful summaries for people unfamiliar with the research topic and that supports this goal. These pages are a beta release and will be updated as we learn how best to help people gain value from a research topic summary.
Turn complex research questions into confident strategic decisions
When you're under pressure to set direction, justify investment, or understand your competitive position, you need more than raw data — you need trusted insights you can act on.
Benchmark your performance against global peers using robust, methodologically sound analysis.
Combine quantitative metrics with qualitative expert insight to uncover strengths, gaps and emerging opportunities.
Gain tailored, decision-ready recommendations aligned to your strategic priorities.
Talk to us to learn more about our data dashboards and bespoke strategy reports.
Grow research skills, confidence and careers with training built for every stage of the research lifecycle.
Developed with Nature Portfolio journal Editors and internationally renowned experts. Discover three ways to learn:
Self-paced, online courses in convenient bite-sized units, covering key skills across scientific writing, publishing, grant writing, data analysis, and more.
Expert trainer-led workshops with hands-on exercises and real-time feedback across core research skills, delivered via interactive group sessions.
Editor-led workshops combining core principles in writing and publishing, personalised 1:1 feedback from Nature Portfolio Editors and hands-on exercises.
Explore course catalogues and workshop agendas, enquire about the options or request institutional pricing.