On Your Feet! Enhancing Vection in Leaning-Based Interfaces through Multisensory Stimuli

Ernst Kruijff, Alexander Marquardt, Christina Trepkowski, Robert W. Lindeman, André Hinkenjann, Jens Maiero, Bernhard Riecke E.
Proceedings of the 2016 Symposium on Spatial User Interfaces - 2016
Download the publication : Kruijff_SUI2016.pdf [2.8Mo]  


When navigating larger virtual environments and computer games, natural walking is often unfeasible. Here, we investigate how alternatives such as joystick- or leaning-based locomotion interfaces (“human joystick”) can be enhanced by adding walking-related cues following a sensory substitution approach. Using a custom-designed foot haptics system and evaluating it in a multi-part study, we show that adding walking related auditory cues (footstep sounds), visual cues (simulating bobbing head-motions from walking), and vibrotactile cues (via vibrotactile transducers and bass-shakers under participants’ feet) could all enhance participants’ sensation of self-motion (vection) and involvement/presence. These benefits occurred similarly for seated joystick and standing leaning locomotion. Footstep sounds and vibrotactile cues also enhanced participants’ self-reported ability to judge self-motion velocities and distances traveled. Compared to seated joystick control, standing leaning enhanced self-motion sensations. Combining standing leaning with a minimal walking in-place procedure showed no benefits and reduced usability, though. Together, results highlight the potential of incorporating walking-related auditory, visual, and vibrotactile cues for improving user experience and self-motion perception in applications such as virtual reality, gaming, and tele-presence.

Images and movies


BibTex references

  author       = {Kruijff, Ernst and Marquardt, Alexander and Trepkowski, Christina and Lindeman, Robert W. and Hinkenjann, Andr{\'e} and Maiero, Jens and Riecke E., Bernhard},
  title        = {On Your Feet! Enhancing Vection in Leaning-Based Interfaces through Multisensory Stimuli},
  booktitle    = {Proceedings of the 2016 Symposium on Spatial User Interfaces},
  series       = {SUI},
  year         = {2016},

Other publications in the database

» Ernst Kruijff
» Alexander Marquardt
» Christina Trepkowski
» Robert W. Lindeman
» André Hinkenjann
» Jens Maiero
» Bernhard Riecke E.