Holograms are changing the way we interact with computers

Because the training can be conducted at any time from anywhere, it is more efficient and cost-effective, says Greg Sullivan, Microsoft’s director of communications. In addition, technicians can get up close to moving engines safely, with the ability to place their hands on virtual engines and parts. “Mechanics can be inside the digital engine while it’s running and can see how the system interacts,” he says.Whether applied in an industrial setting, in gaming or by consumers — for example to see how a new kitchen might look in their home — use of holograms in augmented reality (AR) is being pursued by a growing number of companies.

Florida-based Magic Leap, for example, is developing a device for designers and developers that mixes digital graphics with the physical world, while Looking Glass, a start-up based in Brooklyn and Hong Kong, is developing HoloPlayer One, a portable device roughly the size of a laptop that displays interactive 3D images that can be manipulated with hand gestures.

“What we’ve been seeing with Magic Leap and Microsoft is this desire to figure out the next shift in how human beings interact with information,” says Shawn Frayne, co-founder and chief executive of Looking Glass.

Not all the AR devices being developed use holograms, in the technical sense — photographic recordings of a light field.

“Most of what you’re seeing are not actually holograms,” says Michael Bove, principal research scientist at the object-based media Group at MIT Media Lab. “Hologram has a specific meaning to people in the 3D display community, while to people in the marketing community, it means any three-dimensional image.”

Leaving aside such distinctions, the effect of 3D virtual images can be powerful, as demonstrated by the success of Nintendo’s Pokémon Go. The game uses smartphone cameras to superimpose digital imagery across players’ views of the real world, sending them to parks, streets and landmarks to find and capture virtual creatures.

Other forms of AR are based on similar principles. “It combines computer-generated graphics with what’s going on in the real world,” says Paul Merritt, a technology specialist, based in PA Consulting Group’s Cambridge Technology Centre. This is what distinguishes AR from virtual reality (VR). While users of VR wear goggles or headsets to become immersed in a 3D world, AR technologies place 3D virtual objects in real physical space and allow groups of people to interact with them, opening up the potential for collaboration.

Moreover, users of the technology can do more than view the virtual objects. They can also manipulate them, using hand gestures or voice commands. Many AR devices or systems are equipped with an array of cameras and sensors that enable them to understand the physical environment and the people in it.

“The real magic is the algorithms that fuse the data from all those inputs,” says Mr Sullivan.

Applications of AR range from industrial design to architecture. In medicine, it could increase accuracy, speeding up diagnosis and reducing error rates. It could help surgeons look inside a patient’s body, reducing the need for large incisions.

Prof Bove believes there is more work to be done in developing AR applications. “As of now, there are many fascinating demonstrations but no killer app,” he says. “Everyone is throwing everything into the space and seeing what sticks.”

Meanwhile, when it comes to devices, different approaches are emerging. While some are focusing on developing headsets, others are trying to avoid the use of wearable equipment.

At Looking Glass, this drives company’s approach. Its HoloPlayer One device displays interactive 3D images without the need for goggles or headsets.

“We have a philosophical belief that the real world should be prioritised over going into 3D digital space,” says Mr Frayne.

Regardless of the type of device used, the ability to manipulate virtual objects using voice or gesture will change the way people interact with technology, freeing them from the need to use screens, keyboards and mice. “If I can use gesture and touch, it’s not so much a computer any more, it’s a whole system,” says Mr Merritt.

For Mr Sullivan, the ability to interact with holograms in the same way as with other physical objects will bring people closer to their natural instincts for communication. “Bringing computing into the three-dimensional world that humans have always existed in is the next step in making computing more personal,” he says.