User-Defined Gestural Interfaces in Human-Computer Interaction
Summary
User-defined gestural interfaces empower end users to create, personalise and deploy bespoke movement-based commands for digital systems. Rather than relying on fixed, designer-defined gesture sets, these interfaces employ user-centred elicitation techniques to capture intuitive, context-relevant gestures. This approach accommodates diverse user preferences, cultural norms and ergonomic constraints, yielding higher acceptance and memorability. Core processes include prompting participants to propose gesture-to-command mappings, analysing agreement rates and refining a consensus vocabulary. Gesture tracking may rely on optical sensors, depth cameras, radar-based chips or inertial measurement units, each bringing trade-offs in accuracy, latency and deployment cost. Applications span smart home automation, spatial augmented reality, virtual and augmented reality, wearable computing and public interactive displays. Key challenges lie in ensuring robust recognition across environments, minimising fatigue through ergonomic evaluation, supporting adaptive remapping as user needs evolve and balancing system-level standardisation with personal flexibility. Emerging research addresses comfort evaluation models based on mechanical energy expenditure, radar-based microgesture taxonomies, integration with mixed-reality prototypes and the development of structured datasets to train adaptive interfaces. By harmonising user agency with reliable sensor technologies and well-defined elicitation protocols, the field is charting a path towards more natural, inclusive and efficient gestural interaction paradigms.
Research from Nature Portfolio
No recent Nature Portfolio content available.
User-Defined Gestural Interfaces in Human-Computer Interaction publication trend
The graph below shows the total number of articles in user-defined gestural interfaces in human-computer interaction across all publications each year (not limited to Nature Index journals).
Technical terms
Gesture elicitation: A participatory method in which users propose movement-based commands for mapping to system functions.
Mid-air interaction: Touchless control of digital content or devices through freehand gestures captured by sensors.
Microgestures: Fine-scale, often finger-or wrist-centered, motions intended for precise or discreet input.
Gesture vocabulary: The complete set of distinct gestures assigned to specific commands within an interface.
Spatial augmented reality: The projection or superimposition of digital content onto real‐world surfaces, enabling gestural manipulation in a mixed environment.
References
- Structured dataset of human-machine interactions enabling adaptive user interfaces. Scientific Data (2023).
- Gesture Elicitation Studies for Mid-Air Interaction: A Review. Multimodal Technologies and Interaction (2018).
- Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors. IEEE Access (2019).
- Mechanical Energy Expenditure‐based Comfort Evaluation Model for Gesture Interaction. Computational Intelligence and Neuroscience (2018).
- Design of 3D Microgestures for Commands in Virtual Reality or Augmented Reality. Applied Sciences (2021).
- Mid-Air Gesture Control of Multiple Home Devices in Spatial Augmented Reality Prototype. Multimodal Technologies and Interaction (2020).
About these summaries
This Nature Research Intelligence Topic summary is created with the cited references and a large language model. We take care to ground generated text with facts, and have systems in place to gain human feedback on the overall quality of the process in line with our AI principles. We strive to create accurate and useful summaries for people unfamiliar with the research topic and that supports this goal. These pages are a beta release and will be updated as we learn how best to help people gain value from a research topic summary.
Turn complex research questions into confident strategic decisions
When you're under pressure to set direction, justify investment, or understand your competitive position, you need more than raw data — you need trusted insights you can act on.
Benchmark your performance against global peers using robust, methodologically sound analysis.
Combine quantitative metrics with qualitative expert insight to uncover strengths, gaps and emerging opportunities.
Gain tailored, decision-ready recommendations aligned to your strategic priorities.
Talk to us to learn more about our data dashboards and bespoke strategy reports.
Grow research skills, confidence and careers with training built for every stage of the research lifecycle.
Developed with Nature Portfolio journal Editors and internationally renowned experts. Discover three ways to learn:
Self-paced, online courses in convenient bite-sized units, covering key skills across scientific writing, publishing, grant writing, data analysis, and more.
Expert trainer-led workshops with hands-on exercises and real-time feedback across core research skills, delivered via interactive group sessions.
Editor-led workshops combining core principles in writing and publishing, personalised 1:1 feedback from Nature Portfolio Editors and hands-on exercises.
Explore course catalogues and workshop agendas, enquire about the options or request institutional pricing.