HoloLens contains a custom multiprocessor called the "Holographic Processing Unit," or HPU, which is responsible for processing information coming from all of the on-board sensors, including Microsoft's custom time-of-flight depth sensor, head-tracking cameras, the inertial measurement unit (IMU), and the infrared camera.
Today, in a keynote at CVPR 2017, Harry Shum, announced that the second version of the HoloLens HPU, will incorporate an artificial intelligence (AI) coprocessor that natively and flexibly implement deep neural networks (DNNs).
The new AI chip supports a wide variety of layer types, fully programmable, and is designed to run continuously, off the HoloLens battery.
Mixed reality and artificial intelligence represent the future of computing, and we're excited to be advancing this frontier.
Currently under development, Harry also demostrated an early spin of the V2 of the HPU, running live code implementing hand segmentation.
Microsoft has also today posted an animated guide to mixed reality in a new 'Explanimators' video episode.
"Virtual reality. Mixed reality. Augmented reality"— What's the difference, and how will blending the physical and digital worlds empower you to do things that were previously impossible? More importantly, how will all this affect our pants?
Watch, the video below to learn everything you need to know about mixed reality and the future of human-computer interaction: