Augmented Virtuality Will Open a New Window into Reality
Bringing real-world content into a virtual reality (VR) context is Augmented Virtuality (AV). In many contexts AV is also referred to as Mixed Reality because it captures real-world images from a single viewpoint and inserts them into a virtual reality world. The immersive experience that results is truly out-of-this-world and one that you would not have experienced otherwise.
Imagine when you watched your first IMAX movie in 3D or RealD 3D. It was likely an unforgettable experience. The field of vision was 110 degrees, which almost gets to the level of creating a good immersive experience. While you could sense something breathing down your neck, turning around would reveal that nothing was actually there. And, the sound field array was pretty good, but it was not backed up with the same power visually.
Universal Studios in Hollywood with Peter Jackson created a King Kong 360 degree 3D movie experience that is truly immersive, bringing real-world elements into a photo-realistic, virtual world that tricks your mind and makes you feel as if you’ve been transported into the landscape. Another immersive AV experience is Disney’s Soaring Over California that invokes other senses such as smell and touch with pine scents, water drops, wind, seat movement and false acceleration to further convince your mind that you’ve had a real experience.
Augmented Virtuality is now within the reach of consumers as the tools and technologies are becoming much more affordable. Take, for example, the Google VR Cardboard that retails for only $15, though it requires the viewer to insert a compatible smart phone into the VR Cardboard. There are many other affordable VR systems such as Mattel’s View-Master Virtual Reality, Zeiss VR One Plus, and others.
For Augmented Virtuality, merging real-world content with the virtual world in surprising and exciting ways will be key to enticing consumers to jump onto the bandwagon. Samsung already appears to see significant market opportunity in AV and has leapt into the market head on. Not only did Samsung partner with the VR industry leader, Oculus, on this technology, but the company also created a VR headset, called Gear VR, that goes along with its line of smart phones – the Galaxy S6, S7 and Note5. Samsung also created a great ecosystem of applications that draws from the capabilities of the Oculus VR technology. For example, they offer an experience that takes you into the blood flow, where you piggy back on platelets and journey through the veins. Another app is the Star Chart, which engages you with the night sky and augments the experience with additional information about the planets, the constellations, galaxies and more. Samsung also included a function on its built-in phone camera to take Surround Shots. This enables consumers to take 360 degree stereoscopic images of whatever they please. With this you can create amazing, single viewpoint Augmented Virtuality images that you would likely not have experienced ever before.
I was in Italy recently in really beautiful locations that are truly inspiring, historic and simply incredible. While postcard pictures and images give you some perspective, a 360 degree stereoscopic image is something that you can take with you and can transport you back in time long after to relive the experience. I was able to capture some terrific, 360 degree stereoscopic fixed viewpoint images while in the country. There were a few glitches—like some of the image edges did not align, the depth of vision was incorrect, or some parts of the image were lost while composing the full image etc.—but I expect those will be corrected by better hardware and software over time.
Augmented Virtuality also has a number of potential business uses, such as in video conferences where some attendees sit in a real conference room and others join over VR to engage with the group, including having a true, sidebar virtual conversation. Higher Education is taking advantage of AV by creating immersive educational experiences for students in class, who can not only take advantage of an engaging lecture, but also better understand abstract concepts in architecture, engineering and others by “seeing” them in action.
Today, these applications of AV would require hardware such as the Oculus Rift, HTC Vive and the like, which may still be too pricey for some, but the groundswell has started and consumerization will drive the price down and improve the quality over the coming months. The industry is also working through ways to address physical challenges presented by AV, such as eye fatigue and motion sickness.
The next couple of months will be groundbreaking as Oculus Rift, HTC Vive, PlayStation VR, Microsoft HoloLens, Google and others, who have teamed up with various industries, come out with experiences that will be truly innovative. There are around 230 companies in the VR space, including all the big ones – Facebook, Google, Apple, Amazon, Microsoft, Google, Sony, Samsung – that have invested in large teams just focused on Mixed Reality. Companies such as Magic Leap (www.magicleap.com) are developing solutions that will open completely new streams of possibility for this technology. Magic Leap’s solution generates an illusion of depth in a manner that feels natural, as your eyes focus far for far things and near for near things and adjust based on what you are looking at.
The VR industry has overcome many tough challenges that have been holding back immersive experiences for quite a long time. The time has come where technologists, artists, gamers, educators and the world can look forward to Augmented Virtuality.
