Foveated Depth-of-Field Filtering in Head-Mounted Displays

Martin Weier, Thorsten Roth, André Hinkenjann, Philipp Slusallek
ACM Transactions on Applied Perception, Volume 15, Number 4, page 26:1--26:14 - September 2018, invited article

Abstract

In recent years, a variety of methods have been introduced to exploit the decrease in visual acuity of peripheral vision, known as foveated rendering. As more and more computationally involved shading is requested and display resolutions increase, maintaining low latencies is challenging when rendering in a virtual reality context. Here, foveated rendering is a promising approach for reducing the number of shaded samples. However, besides the reduction of the visual acuity, the eye is an optical system, filtering radiance through lenses. The lenses create depth-of-field (DoF) effects when accommodated to objects at varying distances. The central idea of this article is to exploit these effects as a filtering method to conceal rendering artifacts. To showcase the potential of such filters, we present a foveated rendering system, tightly integrated with a gaze-contingent DoF filter. Besides presenting benchmarks of the DoF and rendering pipeline, we carried out a perceptual study, showing that rendering quality is rated almost on par with full rendering when using DoF in our foveated mode, while shaded samples are reduced by more than 69%.

Images and movies

 

See also

This article is an extended version of the best paper award winning conference paper "Foveated Depth-of-Field Filtering in Head-Mounted Displays" presented at the 15th ACM Symposium on Applied Perception. For citing the conference paper please use

BibTex references conference paper

@InProceedings{WRHS18aSAP,
 author       = {Weier, Martin and Roth, Thorsten and Hinkenjann, Andre and Slusallek, Philipp},
 title        = {Foveated Depth-of-field Filtering in Head-mounted Displays},
 booktitle    = {Proceedings of the 15th ACM Symposium on Applied Perception},
 series       = {SAP '18},
 year         = {2018},
 isbn         = {978-1-4503-5894-1},
 location     = {Vancouver, British Columbia, Canada},
 pages        = {18a:1--18a:1},
 articleno    = {18a},
 numpages     = {1},
 url          = {http://doi.acm.org/10.1145/3225153.3243894},
 doi          = {10.1145/3225153.3243894},
 acmid        = {3243894},
 publisher    = {ACM},
 address      = {New York, NY, USA},
 note         = {Best Paper Award}
}
For citing the journal article use the reference below.

BibTex references

@Article{WRHS18a,
  author       = {Weier, Martin and Roth, Thorsten and Hinkenjann, Andr{\'e} and Slusallek, Philipp},
  title        = {Foveated Depth-of-Field Filtering in Head-Mounted Displays},
  journal      = {ACM Transactions on Applied Perception},
  number       = {4},
  volume       = {15},
  pages        = {26:1--26:14},
  month        = {September},
  year         = {2018},
  note         = {invited article},
}

Other publications in the database

» Martin Weier
» Thorsten Roth
» André Hinkenjann
» Philipp Slusallek