Article In: orcid, dblp

Gaze–hand steering for travel and multitasking in virtual environments

Multimodal Technologies and Interaction

Mona Zavichi; André Santos; Joaquim Jorge — 2025 — MDPI

Key information

Authors:

Mona Zavichi; André Santos; Catarina Moreira; Anderson Maciel (Anderson Maciel); Joaquim Jorge (Joaquim Armando Pires Jorge)

Published in

June 13, 2025

Abstract

As head-mounted displays (HMDs) with eye tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs free viewing, making multitasking difficult. We present a gaze–hand steering technique that combines eye tracking with hand pointing: users steer only when gaze aligns with a hand-defined target, reducing unintended actions and enabling free look. Speed is controlled via either a joystick or a waist-level speed circle. We evaluated our method in a user study (n = 20) across multitasking and single-task scenarios, comparing it to a similar technique. Results show that gaze–hand steering maintains performance and enhances user comfort and spatial awareness during multitasking. Our findings support using gaze–hand steering in gaze-dominant VR applications requiring precision and simultaneous interaction. Our method significantly improves VR navigation in gaze–dominant, multitasking-intensive applications, supporting immersion and efficient control.

Publication details

Authors in the community:

Publisher

MDPI

Link to the publisher's version

https://www.mdpi.com/2414-4088/9/6/61

Title of the publication container

Multimodal Technologies and Interaction

Volume

abs/2504.01906

Fields of Science and Technology (FOS)

computer-and-information-sciences - Computer and information sciences

Keywords

  • gaze-pointing
  • navigation
  • multitasking

Publication language (ISO code)

eng - English

Rights type:

Open access