Updated: Jan 26
Disruptive Technology, like AR/VR, is bringing performance arts to your home.
At the height of the covid pandemic, many cities around the world are in lockdown. Going to the theatre, concerts, and big gathering in public events are banned and the show biz is taking a hit, especially in the big live cities, like London or New York, where residents and tourists love going to see these live performance arts. If the pandemic continues, the show biz might collapse, and the experience of going to live performance will be the thing of the past.
However, it is not all gloomy for theatre-goers as the covid pandemic also bring new opportunities in the entertainment industry. The emerging technology, like AR/VR, shows the potentials to bring the concert experience into your home. The AR/VR latest technology can show musicians or speakers from the other side of the world to be performing live on the stages. How this works is that performers are captured while performing on the stage by cameras and motion capture devices, commonly used in making animation, and then the 3D model of performers are then reconstructed. The constructed model can then be displayed AR/VR or immersive display technology, which allows the viewers to see more realistic models, as the viewers can see in 3D space, unlike TVs, which limits you to only see the models in 2D.
Credit: The musician Queen in hologram. https://www.azernews.az/culture/55943.html
Making 3D models of live actors is simple, it can be done even from a mobile phone with motion sensors
The common input to these AR/VR and immersive display technology are 3D models. To obtain the 3D models of actors, the latest input capturing device is iPhone 12, which is equipped with Lidar sensors. The sensors allow the accurate depth information and the movement of the actors to be captured, and this information is then used to create a life-like model of an actor. This technology is becoming very popular and we will soon see people making the 3D models of themselves. The 3D models can then displayed in the VR headsets as is or even better the 3D models can be augmented and show in the AR headset. With augmented reality, the models can, for example, change hairstyle, or change clothes and the movements can be used by the real actors. The animated models can also be performing with live actors with the technology. The current VR/AR technology requires users to wear headsets, which are not so friendly.
Avatar is animated by the motion of the actor using motion capture technology
The immersive display lets you see the performance in 3D, unlike normal TVs
With the immersive display technology, 3D models and scenes can be perceived without losing the depth details, unlike normal TVs. The immersive display can show models in 3D as if the models are floating or recede into the screen, creating the illusion of realism. In the past, a 3D animated model like Mr Smith, a fictional character with eye-catching dance moves (shown above), will just be contained in a normal 2D screen and the viewers are probably not able to get all of his expressions. Now, much more of his expressions can be understood and seen as the viewers can see him gliding along the dance floor in a 3D immersive display, which is the best way to display 3D information.
A 3D avatar dancer display on an immersive display
However, the current immersive display technologies are still expensive and not widely available. But with Holo-SDK, you can turn your normal screen into a 3D immersive display at a very low cost. All you need is red and blue glasses, which is very cheap, and Holo-SDK. To get an example of immersive experience created from your normal computer, you can download some sample applications, www.holo-sdk.com
Get Holo-APP here: https://www.holo-sdk.com/sample-apps
Follow us of Twitter: https://twitter.com/PerceptionCodes
Follow us on YouTube: https://www.youtube.com/channel/UCsiRcn3XRJQsAUoWmQQH9Rg