Counterpoint Research and DSCC hosted the AR/VR Display Summit 2024 in Silicon Valley, US, in October. The event brought together leading companies and experts from the AR/VR display ecosystem to discuss cutting-edge developments in displays and optics, along with key trends shaping the market. Senior Director of AR/VR Display and Optics at Meta Ajit Ninan also gave a presentation on the role of perception in AR/VR.

For conventional flat-panel displays, there are four axes that determine image quality —resolution, dynamic range, frame rate, and color gamut. According to Ninan, near-eye displays (NED) should be assessed along nine axes. Another complication is that what the brain perceives is not the same as what the retina sees. Therefore, it is important to define perceptual units and not just physical units. VP of Research at Counterpoint Research Peter Richardson sat down with Ninan to discuss displays and perceptual imaging in XR.

The Interview

Key Takeaways from the Discussion

• Conventional metrics for displays are not always suitable for AR/VR. Wearable displays will require new standards to define how effective they are at presenting an image to the brain that is consistent with the world. The goal is to use displays to build “perceptual engines”.
• Meta wants to encourage the industry to start thinking about the temporal and spatial aspects of displays. For example, a low frame rate may be acceptable on a TV but not on a wearable display due to head motion. Resolution requirements are also different.
• Delta E is a metric commonly used by the display industry to measure color accuracy. However, it does not work so well for AR/VR. Typical metrics for displays do not allow us to define what the experience will be like for the user. Meta would like to start standardizing new metrics that are specific to AR/VR.
• A truly immersive AR experience is where the user cannot tell the difference between the real world and the projected image. This is the North Star that guides the development of new technologies, which will be integrated into products one step at a time.
• However, it is still possible to think of useful experiences without having full immersion. The introduction of AI gives more possibilities to develop different types of products, even if the display technology is still far from perfect.

Analyst Takeaways

• Meta is developing headsets and smart glasses that will provide new user experiences. However, this is a difficult challenge that requires pushing the boundaries of existing technologies. Meta knows that it cannot do this alone and wants the industry to work towards a common goal.
• Displays are critical components in AR and VR. However, display manufacturers have been focused on large markets, such as smartphones and TVs. By defining new standards, Meta can set the roadmap for the display industry.
• Meta has also recently unveiled its Orion prototype smart glasses, showing what the state of the art looks like today.