Virtual Avatars | NINJAR Blog

Virtual Avatars

A series of essays from exploring how living on the Reality-Virtuality Continuum will change how we live, work, love and play.

Read Part 4 in this series for how A.I. is going to mix with X.R. to create a new fabric to reality.

Redesigns of current mobile apps for the world of Extended Reality are going to change everything. One of the most popular apps - video streaming - will be one of the first to be changed by the Mixed Reality paradigm shift. Instagram already has virtual humans which attract over a million followers:

Lil Mequela

Today there are online celebrities in China who make over $10,000,000 a year streaming their lives into webcams and broadcasting to paying subscribers. These streams will soon be popping out of the tiny restrictions of the mobile screen and appearing as holograms, dancing in your living room. Then the stage is set to make take these traditional mass broadcasts and make them individually tailored to each paying subscriber. The use of Mixed Reality together with A.I. mixes together to make a brilliant new show, broadcast 24/7 with you as the star, surrounded by your favourite celebrities. Welcome to the future of TV.

Japan is already ahead here, with the fictional character, Hatsune Miku, already being adored by fans and appearing all around the world in a holographic form:

The target audience of these Mixed Reality broadcasts from real celebrities should bypass the classical Otaku - the geek who sits in his room and only interacts with girls in computer games - to turn the heads of all youtube viewers.

It will create a new form of broadcast entertainment where the stage is your living room and the virtualised actors are communicating with you in your intimate spaces. The first stage of this will be fixed hologram recordings, locked to a spot in your house via Augmented Reality.

For example we can imagine youtube celebs like a virtual Beyonce coming into your house, sitting on your sofa and looking across to talk to you.

The paradigm of entertainment will shift from being a distraction to being a companion.

When these lifelike avatars are driven by A.I. the show will never really end. And at the end of each day the bell d’jour will be in your bedroom acting our bedroom stuff:

This next stage of Mixed Reality streaming – where A.I is being used to manipulate generative characters will be the most interesting. This kind of entertainment will be created in your house and broadcast out of it. The celebrity will supply the avatar and then each fan will enjoy a unique experience, depending on their environment and individual reactions. Because of this everyone will be constantly streaming experiences with their favourite characters incase something unique happens.

This kind of bi-directional mass media has never been seen before and is perfectly suited to the Mixed Reality platform. It could soon become the new way of influencer marketing - with popular stars being used to sell everything on a very personal level.

More ideas on how Mixed Reality will be used to sell everything here: [How Mixed Reality will be used to sell everything]

Today we already get glimpses of this future in developer demos:

In is not crazy to think in a couple of years people will live alongside these virtual avatars, using them for entertainment, companionship and more. Combining A.I. Avatars with an algorithmic gaze will allow them to understand the context of beds, chairs, doors and help them live convincingly alongside their loyal fans.

Magic Leap seems to be at the forefront of this idea with hardware and software available to the public to make this happen today:

Amazon also recognised the importance of characters in the MR space and has pushed ahead with its Sumerian Project:

Although still young, Amazon’s Sumerian paves the way for virtual actors that can appear in VR or AR spaces and can be communicated via Alexa’s natural spoken language.

These Mixed Reality Avatars will have a view of the same room you are looking at ( either via your mobile camera, or via another camera you might install in your home for permanent A.I., which Amazon also sells).

DEEPLENS

This algorithmic gaze will give Mixed Reality avatars total contextual understanding of your home and life. It is likely that these ‘bot-eye’ cameras will be installed in every room in every home for your personal AR avatars to see through. Amazon is ahead here again, as it already sells Alexa units of varying sizes - intended one for each room. It’s not beyond the imagination to assume users will be happy buying Echo Dots with cameras on for the use of home avatar systems.

For example you could put an A.I. camera in your kitchen, to watch the fridge and stove, and another by your front door to watch you come in. This would be enough for the AI driven M.R. avatar to know what you have in left in your fridge, to remind you to do the shopping, to watch what you have eaten, to tease you about your diet and even teach you to cook. And it can watch the stove whilst you are out of the room. It should do all this naturally. When the kettle is boiling the algorithmic gaze will see the steam, and the Avatar will notify me.

An A.I. camera placed on your front door will ensure your friendly avatar is always there to greet you will a big smile when you come back home. Maybe these avatars will take the shape of dogs, cats, or branded cartoon characters.

And lets not forget there are funded companies working on Mixed Reality technology that does not require the user to wear or hold any devices to see this reality, holographic projections are possible:

Lightfields

Mixed Reality, with the combination of Computer Vision, A.I. and digital overlays will allow everyday human behaviours to be offloaded from your mind to another system without needing complex infrastructure to connect devices or expensive robotics to interact with humans and systems. In the near future it is very likely we will live and work alongside intelligent robots, but only in the virtual sense.

Next consider that these M.R. avatars could not only be celebrities – they could be whoever you fancy, or they could be long distance friends, deceased relatives or even clones of yourself. This technology is here today, nascent, and possible. It is one of the areas Ninjar is exploring as future use cases for M.R.

We believe the utilisation of M.R. Avatars will be for more than just entertainment, they will be customer service representatives and skilled tradesman too.

For example if you want to see how a new BMW looks in your driveway, you can just place one there via AR. ( We’ve done plenty of work on this, as you can see here: ninjar.com/work )

But A.R. is not the best sales pitch by itself, not compared to the experience of visiting a showroom and having a brand employee pitch emotionally to you about the upgrade.

M.R. avatars will become virtual salespeople.

Part of our vision at ninjar.com is that when you drop an A.R. car on your driveway you should expect a M.R. salesperson to come along for the ride. They will know what you are looking at and respond correctly – if you move your phone for a closeup of the alloys you can expect them to say “Hey, Good choice on those wheels - I can give them to you for a free upgrade…”

One argument we hear to the idea of Mixed Reality avatars is “But they can’t do anything real – they can’t touch anything… They can’t pick up a hammer and knock down a wall!”.

This is true, but then again – when was the last time you picked up a hammer or used any tool to permanently change the real world? For most of us we live in world where the physical manipulation of hardware is outdated or automated. Food is delivered precooked and in disposable trays. Apartments come serviced and need little maintenance. Home based mechanical repair is a thing of the past, replaced with planned obsolescence, appliance trade-ins and annual upgrade plans. It is almost like modern life has left a void in the homes where real world tools, and robots, are no longer essential.

Conclusion Mixed Reality avatars, combined with ubiquitous A.I. cameras, might be our main access to computation in the near future. They will see what we see, yet they will have the superhuman intelligence, memory and connections from the cloud. They will become so useful we will miss them when they are not there. They will look astonishingly real:

Extra Notes… But will this be an authentic experience that people will want? We’ve learnt from mobile apps and social networks that desire is easy to manipulate. Social App designers use a technique called F.O.M.O. - Fear of Missing Out - to drive retention. This psychological trick keeps us checking social feeds for fear we might miss a post from a friend. This hijacking of user’s minds to increase retention will be strengthened further by the natural behaviours of the realistic M.R. avatars and the consideration that they will be a channel for all our important messages, friendships and potential sexual opportunities.

For example, in the world of M.R. avatars, if i want to send you a message to ask you something, I can ‘send’ my avatar – my clone – over to your house to ask. And you can answer back and I will see your avatar, your clone sitting next to me. This natural interface might make today’s chat apps look ridiculously basic and is probably part of the reason why Facebook invested a hefty sum to buy Oculus. They realise the future of Social is M.R.

This idea of a virtual space filled with believable avatars that hold and mediate the connections between us and the rest of humanity is and should be scary. This new interface will become the truth of our news, our friends, potential dates and all product sales and will become a powerful platform. The combination of an Information Technology, and a Social Network, along with a emotion display via realistic humans is uniquely powerful.

There are other, possibly negative, effects of surrounding yourself with M.R. avatars. Consider the fact that when your phone is near you get stupid. The findings of a study in Social Psychology publication found that the “mere presence” of a mobile – even when it is not being used – influenced simple mental performance. It was noted that when a user’s phone was in view the person did 20% worse at a given task. Imagine how lazy your mind would become when surrounded by A.I. driven avatars.

For companies looking to get into VR/AR/MR our Virtual Reality services offer guidance on how these technologies can enhance and support your brand strategy.

Connect with us on LinkedIn and follow @ninjar on Twitter or send us an email to hello@ninjar.com

Recommended Articles

Opinions and thoughts on the current state of XR from industry experts

VR Creation Made Simple

10 Sep by Marco

"Our team spent seven years creating innovative digital products. During this time, we were lucky to establish and collaborate with a network of world-class developers, designers, and product managers to create beautiful, functional software..."

Why ninjAR is a Platform and Why That Matters

11 Sep by Matt

"Everywhere we look we see the world becoming virtual. Everything we know, such as media, currencies, businesses, products, services and even people are being converted to digital assets..."

VR | AR | MR — What do these buzz words really mean

12 Sep by Sabina

"In 2018 we are now able to mix the real world with virtual worlds in very realistic ways — and this technology is just getting started!"

How Can Reality Be Extended?

12 Sep by Matt

"When we built the computers to help us - we created an exo-cortex. A part of our mind outside our bodies. It extends our thoughts, our consciousness, via digital signals.."

Technology Extends Reality

15 Sep by Matt

"We are creating the hive mind. Wires linking everything. We are building another world inside our heads, and we are teaching A.I how to thrive there. But is it what we ultimately want?.."

Digital Reality and Culture

18 Sep by Matt

"There is an interesting bias in modern culture – people are mainly hired for scientific and technical knowhow — not for humanity, morality, religion or creative talent.."

Artificial Intelligence and XR

21 Sep by Matt

"Cameras are the eyes of AI, and they are everywhere.The first steps into the brave new world of Extended Reality will happen through the existing hardware of mobile phones.."

Virtual Avatars

23 Sep by Matt

"Instagram already has virtual humans which attract over a million followers. The use of X.R. together with A.I. mixes together to make a brilliant new show, broadcast 24/7 with you as the star.."

The Future of XR is Serious Business

12 Oct by Marco

"Instagram already has virtual humans which attract over a million followers. The use of X.R. together with A.I. mixes together to make a brilliant new show, broadcast 24/7 with you as the star.."

VR Sickness — what it is & what we can do about it

15 Oct by Sabina

"What is it that makes putting on a headset and stepping into a virtual world feel like you are on a rocking sailboat about to be hurled into the ocean?"

How 3D & VR makes automotive design 100x better

7 Nov by Sabina

"Years ago if you wanted to buy a car, you would walk onto the lot and be shown models by some salesman, who would disclose the information he wanted to, often times at the expense of the buyer.."

Immersive Communication

12 Nov by Matt

"Visualising imaginary places and objects is fine - But what about people? How can immersive technology help bring people together, and improve our social lives?.."

Connect with Your Users or Perish

16 Nov by Marco

"Looking at a study done by Harvard Business Review and Microsoft showing the growing trend of MR that is too strong to deny.."

See all articles