Multisensory Proximity and Transition Cues for Improving Target Awareness in Narrow Field of View Augmented Reality Displays

Christina Trepkowski, Alexander Marquardt, David Eibich, Yusuke Shikanai, Jens Maiero, Kiyoshi Kiyokawa, Johannes Schöning, Peter König
IEEE Transactions on Visualization and Computer Graphics, Volume Early Access - 2021
Download the publication : Multisensory_Proximity_and_Transition_Cues_for_Improving_Target_Awareness_in_Narrow_Field_of_View_Augmented_Reality_Displays.pdf [32.6Mo]  


Augmented reality applications allow users to enrich their real surroundings with additional digital content. However, due to the limited field of view of augmented reality devices, it can sometimes be difficult to become aware of newly emerging information inside or outside the field of view. Typical visual conflicts like clutter and occlusion of augmentations occur and can be further aggravated especially in the context of dense information spaces. In this paper, we evaluate how multisensory cue combinations can improve the awareness for moving out-of-view objects in narrow field of view augmented reality displays. We distinguish between proximity and transition cues in either visual, auditory or tactile manner. Proximity cues are intended to enhance spatial awareness of approaching out-of-view objects while transition cues inform the user that the object just entered the field of view. In study 1, user preference was determined for 6 different cue combinations via forced-choice decisions. In study 2, the 3 most preferred modes were then evaluated with respect to performance and awareness measures in a divided attention reaction task. Both studies were conducted under varying noise levels. We show that on average the Visual-Tactile combination leads to 63% and Audio-Tactile to 65% faster reactions to incoming out-of-view augmentations than their Visual-Audio counterpart, indicating a high usefulness of tactile transition cues. We further show a detrimental effect of visual and audio noise on performance when feedback included visual proximity cues. Based on these results, we make recommendations to determine which cue combination is appropriate for which application.

Images and movies


See also

This project received the IEEE Replicability Stamp (see here.)

BibTex references

  author       = {Trepkowski, Christina and Marquardt, Alexander and Eibich, David and Shikanai, Yusuke and Maiero, Jens and Kiyokawa, Kiyoshi and Sch{\"o}ning, Johannes and König, Peter},
  title        = {Multisensory Proximity and Transition Cues for Improving Target Awareness in Narrow Field of View Augmented Reality Displays},
  journal      = {IEEE Transactions on Visualization and Computer Graphics},
  volume       = {Early Access},
  year         = {2021},

Other publications in the database

» Christina Trepkowski
» Alexander Marquardt
» David Eibich
» Jens Maiero
» Kiyoshi Kiyokawa
» Johannes Schöning