Microsoft sends HOLOLENS to the ISS for astronauts

December 14, 2015

Microsoft Hololens will go to the International Space Station (ISS) so that astronauts can experience augmented reality.

As if floating in space isn't awesome enough, NASA recently announced that it has sent the revolutionary Hololens of Microsoft on the International Space Station last week. Under the operational name Project Sidekick, this "bundle" is not just a testbed for Microsoft's augmented reality unit, but also an ingenious way to help astronauts communicate with each other more effectively. Along with a power shipment, the devices were sent last week aboard the spacecraft Cygnus.

Although there was a slight delay that set back the program last June, the decision of the NASA to go ahead with its partnership with Microsoft was reinforced by the awesome advantages that the augmented reality device could have for astronauts. As stated above, Hololens has the potential to make working in space much easier for astronauts. While a device like Samsung's Oculus Rift creates a separate environment, Microsoft's technology combines digitally created objects with what astronauts actually see without cutting them off from their environment.

Unlike virtual reality, which cuts you off from your environment, virtual reality Hololens works harmoniously with the real world without cutting you off from it. "We add photos to the back of your eye. They look anchored in the real world, but they're permeable at the same time," said Microsoft's Alex Kipman.

Using the various functions of the device, astronauts on the International Space Station can work with those on Earth in real time. With the device in "remote expert mode" (advanced remote use), ground teams can see what the astronaut is seeing, remotely plan or give instructions, and talk directly to the astronaut via Skype. In addition, this feature allows astronauts to consult with multiple experts or scientists while working on a project.

"HoloLens and other virtual or augmented mixed reality devices are cutting-edge technologies that could help future exploration and provide new possibilities for the men and women of the PPD", said the PPO's program director, Sam Sciemi this summer. "This new technology could help future explorers to gain greater autonomy on their journey to Mars."

Because Project Sidekick involves a large number of difficulties and complications to explore, Microsoft and NASA worked very hard to ensure that the whole project would not go to waste. Beyond micro-gravity issues and extensive testing on the device, the two organizations spent endless hours to confirm that the HoloLens would not cause disorientation problems for those wearing it.

Something that is common with augmented reality devices is that some people experience feelings of nausea and headaches with prolonged use. To counteract this, a special stabilization agent was incorporated, which keeps the hologram stable in space and time. What it achieves is that it gives the astronaut the feeling of being connected to the real world (the hologram), reducing image flicker and thus making the device comfortable to use for longer.

The use of HoloLens in the Project Sidekick, is the tip of the iceberg in Microsoft's partnership with NASA. Also in development by both is a revolutionary software, called OnSight, which is also working with HoloLens. Under the guidance of NASA's Jet Propulsion Laboratory, OnSight will allow scientists on Earth to work simultaneously with astronauts travelling to Mars, virtually taking them to the red planet while they remain on Earth.

Last Tuesday, the power shipment that would have transported the devices to the PPD, launched from Cape Canaveral and featured online on NASA's NASA TV.

Watch the video here: