Virtual reality has been around for a few decades now, but one of the key features that made it so popular was the ability to immerse oneself in a simulated environment. This was possible thanks to retinal projection, which allowed users to see virtual objects as if they were really there. However, over time this feature has gradually been removed from VR headsets. Nowadays, most VR headsets only allow for limited head movement and no retinal projection at all. This is likely due to the fact that it is difficult to create realistic virtual environments with only these two features available. It is possible that retinal projection will make a comeback in future VR headsets, as developers continue to explore new ways of creating realistic virtual worlds. Until then, users will have to settle for less immersive experiences. ..
Understanding Virtual Retinal Displays
All of the flat panel displays you look at every day have a pixel grid and then either shine a backlight through that pixel grid, or the pixels themselves will emit light in the case of OLED displays.
Virtual Retinal Displays work more like the CRT (Cathode Ray Tube) monitors and TVs of days displayed, where an image raster is drawn on the back of a phosphorescent screen. Except, in this case, the image is drawn directly onto the retina of the eye.
The end result is what appears to be a screen floating in space, or an image that seems to be part of the scene.
Why Do We Want Retinal Projection?
Retinal projection has a number of advantages over current display technologies. While early retinal projection systems were bulky and heavy, modern systems use lightweight laser systems or modern LED technology to shoot photons into your eyes.
Current VR headsets use one or more flat panel displays viewed through special lenses that untwist the precisely distorted image on the LCD or OLED display. This results in an image shaped in such a way that it provides an immersive experience. Unfortunately, this design often results in visible pixel grids (the “chicken wire” or “screen door effect”) and somewhat fuzzy visuals.
In contrast, the resolution and crispness of retinal projection images are exceptional. They don’t cause the same amount of eye strain as OLEDs or LCD screens an inch from your eye, thanks to the small amount of light needed.
Retinal projection systems also have optical advantages. This technology allows for optical correction on the fly, so you don’t need to worry about wearing glasses. It can also refocus to display near or far objects.
For VR or Mixed Reality (MR) headsets, retinal projection systems have the potential to make much smaller, less power-hungry sets. The holy grail for any sort of VR or MR headset is to eventually shrink them down to the size of sunglasses.
The Limitations of Retinal Displays
There are a few limitations of retinal projection that make it less than ideal as a replacement for the VR systems of today. First of all, the field of view possible with current retinal projection is too narrow for VR. This means it’s not immersive enough to meet the standards for modern VR experiences.
Retinal displays use various approaches to project images into the eye, including sophisticated micro-mirror arrays or precisely angled lasers. Tiny moving parts such as these are inevitably harder to make than solid-state systems such as an OLED screen. That complex under-the-hood system creates a lot of hurdles in the development process.
What Happened to Avegant?
You may or may not know it, but there is actually a retinal projection technology headset you can buy and own. In 2016 a company called Avegant released the Avegant Glyph. The Glyph looks like a pair of standard headphones, but you can flip the headband down over your eyes and enjoy a video feed projected onto your retinas. It didn’t look like VR, but it was a 720p home theater system that you could take anywhere with you.
That said, Avegant is very much still around and working on pushing its technology forward, perhaps so that a partner company (such as Facebook perhaps) could one day create a successful mainstream system. And while Avegant is the only company we know of that has brought out a commercial VRD product, many different players are investing in research and development to make VRD technology a reality.
In 2020, Bosch showed off smartglasses that use lasers to project images into your retinas. QD Laser’s Viserium used retinal projection to help people with low vision see more clearly. Magic Leap is working on next-generation augmented reality, and the list of companies working involved with VRD technology has at least a half-dozen more names to add.
Retinal Projection Might Be the Future of Mixed Reality
While current retinal projection might not be the best first for VR, it may have a future in MR applications. Devices like the Microsoft Hololens 2 incorporate laser-based retinal projection and don’t require large fields of view to be useful.
If retinal projection technology ever manages to achieve the same horizontal field of view as consumer VR headsets like the Quest 2 it might still end up being the most realistic and sharp VR solution short of jacking a computer directly into your visual cortex.
RELATED: The Brain-Implant Future Is Almost Here. Are You Up for It?
