Article In: orcid, dblp
Gaze–hand steering for travel and multitasking in virtual environments
Multimodal Technologies and Interaction
— 2025 — MDPI
Key information
Authors:
Published in
June 13, 2025
Abstract
As head-mounted displays (HMDs) with eye tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs free viewing, making multitasking difficult. We present a gaze–hand steering technique that combines eye tracking with hand pointing: users steer only when gaze aligns with a hand-defined target, reducing unintended actions and enabling free look. Speed is controlled via either a joystick or a waist-level speed circle. We evaluated our method in a user study (n = 20) across multitasking and single-task scenarios, comparing it to a similar technique. Results show that gaze–hand steering maintains performance and enhances user comfort and spatial awareness during multitasking. Our findings support using gaze–hand steering in gaze-dominant VR applications requiring precision and simultaneous interaction. Our method significantly improves VR navigation in gaze–dominant, multitasking-intensive applications, supporting immersion and efficient control.
Publication details
Authors in the community:
Anderson Maciel
ist429193
Joaquim Armando Pires Jorge
ist13909
Publisher
MDPI
Link to the publisher's version
https://www.mdpi.com/2414-4088/9/6/61
Title of the publication container
Multimodal Technologies and Interaction
Volume
abs/2504.01906
Fields of Science and Technology (FOS)
computer-and-information-sciences - Computer and information sciences
Keywords
- gaze-pointing
- navigation
- multitasking
Publication language (ISO code)
eng - English
Rights type:
Open access