HoloLens update for Windows 10 April 2018 Update slated to deliver important updates to IT administrators, developers, and commercial HoloLens customers will be available soon.
In the mean time, Microsoft has released a limited-time free preview of Remote Assist and Microsoft Layout that introduces mixed reality in the modern workplace.
With Remote Assist HoloLens app customers will be able to collaborate remotely with heads-up, hands-free video calling, image sharing, and mixed-reality annotations.
Watch this video below for a sneak peek into what Microsoft Remote Assist will make possible:
With Layout, a new app will help people use HoloLens to bring space designs from concept to completion much more quickly by viewing their designs at real-world size and scale.
Here is a peek into what Microsoft Layout makes possible:
Here’s a video demonstrating how ZF Group has been using Remote Assist and Layout over the past couple of months:
Microsoft HoloLens update which is already in testing phase with Windows Insider Program generally become available in the next few weeks. This Windows 10 April 2018 Update (also knows as Redstone 4 (RS4)) will bring along a few important updates tageted for IT administrators, developers, and commercial customers, includes:
For IT administrators improvements enabling them to provision, secure, manage, and update all HoloLens devices in organization, including scenarios where multiple people use the same device will be available.
This update will also simplify and automate device management by improving support for Unified Endpoint Management solutions (also known as MDM) like Microsoft Intune. “Microsoft Intune, powered by intelligent cloud, empowers employees to create and work together, securely, and enables organizations to protect corporate data in today’s diverse and complex mobile environment.”
Microsoft is also bringing additional Unified Endpoint Management providers on board, including IBM MaaS360, MobileIron, and SOTI, so they can integrate and deliver HoloLens-based solutions to market soon.
For developers, Microsoft is launching improvements to spatial mapping and also adding automatic selection of focus point to improve hologram stability, a new holographic projection modes, as well as new APIs.
The update will also deliver a new feature called, “Research mode,” that will let developers building academic and industrial applications to test new ideas in the fields of computer vision and robotics by accessing key HoloLens sensors.
Lastly, improvements for customers using HoloLens will bring artificial intelligence (AI)-powered features, like auto-placement of new content (2-D and 3-D) on launch for seamless mixed-reality experiences.
- A new ability to fluidly manipulate apps when moving, resizing, and rotating 2-D or 3-D content without entering into “adjust” mode.
- Ability to create a 2-D UWP app like Mail wider to see more content.
- Expanded voice command support let you do more simply using voice.
- Updated apps, including Holograms and Photos as well as improved mixed-reality capture with a hardware shortcut.
- Also, a new support for File Manager and Media Transport Protocol is now available, so you can connect HoloLens to a PC for easy files transfer.
- Simplified holograms space management and improved immersive spatial audio, so you can now hear HoloLens better in noisy environments, and experience more lifelike sound from apps, Because. their sound will be obscured by real walls detected by the device.
The RS4 Update in addition also includes new features for Windows Mixed Reality immersive headsets connected to PCs along with HoloLens.
To update to latest release on PC for Windows Mixed Reality immersive (VR) headsets, head over to the Settings app, then go to ‘Update & Security,’ and select ‘Check for updates.’ And, to update to latest release on HoloLens, you can manually install the software using Windows Device Recovery Tool (WDRT).
For a detailed description of the new capabilities and other installation instructions, head over to the Windows 10 April 2018 Update page here.
In the video below you can watch an overview of new mixed reality features in the Windows 10 April 2018 Update:
New features for HoloLens
For all users
Feature Details Instructions Auto-placement of 2D and 3D content on launch A 2D app launcher or 2D UWP app auto-places in the world at an optimal size and distance when launched instead of requiring the user to place it. If an immersive app uses a 2D app launcher instead of a 3D app launcher, the immersive app will auto-launch from the 2D app launcher same as in RS1.
A 3D app launcher from the Start menu also auto-places in the world. Instead of auto-launching the app, users can then click on the launcher to launch the immersive app. 3D content opened from the Holograms app and from Edge also auto-places in the world.
When opening an app from the Start menu, you will no longer be asked to place it in the world.
If the 2D app/3D app launcher placement is not optimal, you can easily move them using new fluid app manipulations described below. You can also re-position the 2D app launcher/3D content by saying “Move this” and then using gaze to re-position the content.
Fluid app manipulation Move, resize, and rotate 2D and 3D content without having to enter “Adjust” mode. To move a 2D UWP app or 2D app launcher, simply gaze at its app bar and then use the tap + hold + drag gesture. You can move 3D content by gazing anywhere on the object and then using tap + hold + drag.
To resize 2D content, gaze at its corner. The gaze cursor will turn into a resize cursor, and then you can tap + hold + drag to resize. You can also make 2D content taller or wider by looking at its edges and dragging.
To resize 3D content, lift up both your hands into gesture frame, fingers up in the ready position. You’ll see the cursor turn into a state with 2 little hands. Do the tap and hold gesture with both your hands. Moving your hands closer or farther apart you will change the size of the object. Moving your hands forward and backward relative to each other will rotate the object. You can also resize/rotate 2D content this way.
2D app horizontal resize with reflow Make a 2D UWP app wider in aspect ratio to see more app content. For example, making the Mail app wide enough to show the Preview Pane. Simply gaze at the left or right edge of the 2D UWP app to see the resize cursor, then use the tap + hold + drag gesture to resize. Expanded voice command support You can do more simply using your voice. Try these voice commands:
- “Go to Start” – Brings up the Start menu or exits an immersive app.
- “Move this” – Allows you to move an object.
Updated Holograms and Photos apps Updated Holograms app with new holograms. Updated Photos app. You will notice an updated look to the Holograms and Photos apps. The Holograms app includes several new Holograms and a label maker for easier creation of text. Improved mixed reality capture Hardware shortcut start and end MRC video. Hold Volume Up + Down for 3 seconds to start recording MRC video. Tap both again or use the bloom gesture to end. Consolidated spaces Simplify space management for holograms into a single space. HoloLens finds your space automatically, and no longer requires you to manage or select spaces. If you have problems with holograms around you, you can go to Settings > System > Holograms > Remove nearby holograms. If needed, you can also select Remove all holograms. Improved audio immersion You can now hear HoloLens better in noisy environments, and experience more lifelike sound from applications as their sound will be obscured by real walls detected by the device. You don’t have to do anything to enjoy the improved spatial sound. File Explorer Move and delete files from within HoloLens. You can use the File Explorer app to move and delete files from within HoloLens.
Tip: If you don’t see any files, the “Recent” filter may be active (clock icon is highlighted in left pane). To fix, select the This Device document icon in the left pane (beneath the clock icon), or open the menu and select This Device.
MTP (Media Transfer Protocol) support Enables your desktop PC to access your libraries (photos, videos, documents) on HoloLens for easy transfer. Similar to other mobile devices, connect your HoloLens to your PC to bring up File Explorer to access your HoloLens libraries (photos, videos, documents) for easy transfer.
- If you don’t see any files, please ensure you sign in to your HoloLens to enable access to your data.
- From File Explorer on your PC, you can select Device properties to see Windows Holographic OS version number (firmware version) and device serial number.
Known issue: Renaming HoloLens via File Explorer on your PC is not enabled.
Captive portal network support during setup You can now set up your HoloLens on a guest network at hotels, conference centers, retail shops, or businesses that use captive portal. During setup, select the network, check connect automatically if desired, and enter the network information as prompted.
Feature Details Instructions Spatial mapping improvements Quality, simplification, and performance improvements. Spatial mapping mesh will appear cleaner – fewer triangles are required to represent the same level of detail. You may notice changes in triangle density in the scene. Automatic selection of focus point based on depth buffer Submitting a depth buffer to Windows allows HoloLens to select a focus point automatically to optimize hologram stability. In Unity, go to Edit > Project Settings > Player > Universal Windows Platform tab > XR Settings, expand the Windows Mixed Reality SDK item, and ensure Enable Depth Buffer Sharing is checked. This will be automatically checked for new projects.
For DirectX apps, ensure you call the CommitDirect3D11DepthBuffer method on HolographicRenderingParameters each frame to supply the depth buffer to Windows.
Holographic reprojection modes You can now disable positional reprojection on HoloLens to improve the hologram stability of rigidly body-locked content such as 360-degree video. In Unity, set HolographicSettings.ReprojectionMode to HolographicCameraRenderingParameters.ReprojectionMode to HolographicReprojectionMode.OrientationOnly when all content in view is rigidly body-locked. App tailoring APIs Windows APIs know more about where your app is running, such as whether the device’s display is transparent (HoloLens) or opaque (immersive headset) and whether a UWP app’s 2D view is showing up in the holographic shell. Unity had previously manually exposed HolographicSettings.IsDisplayOpaque in a way that worked even before this build.
For DirectX apps, you can now access existing APIs like HolographicDisplay.GetDefault().IsOpaque and HolographicApplicationPreview.IsCurrentViewPresentedOnHolographicDisplay on HoloLens as well.
Research mode Allows developers to access key HoloLens sensors when building academic and industrial applications to test new ideas in the fields of computer vision and robotics, including:
- The four environment tracking cameras
- Two versions of the depth mapping camera data
- Two versions of an IR-reflectivity stream
Research mode documentation
Research mode sample apps
For commercial customers
Feature Details Instructions Use multiple Azure Active Directory user accounts on a single device Share a HoloLens with multiple Azure AD users, each with their own user settings and user data on device. IT Pro Center: Share HoloLens with multiple people Change Wi-Fi network on sign-in Change Wi-Fi network before sign-in to enable another user to sign in with his or her Azure AD user account for the first time, allowing users to share devices at various locations and job sites. On the sign-in screen, you can use the network icon below the password field to connect to a network. This is helpful when this is your first time signing into a device. Unified enrollment It’s now easy for a HoloLens user who set up the device with a personal Microsoft account to add a work account (Azure AD) and join the device to their MDM server. Simply sign in with an Azure AD account, and enrollment happens automatically. Mail Sync without MDM enrollment Support for Exchange Active Sync (EAS) mail sync without requiring MDM enrollment. You can now sync email without enrolling in MDM. You can set up the device with a Microsoft Account, download and install the Mail app, and add a work email account directly.
For IT pros
Feature Details Instructions New “Windows Holographic for Business” OS name Clear edition naming to reduce confusion on edition upgrade license application when Commercial Suite features are enabled on HoloLens. You can see which edition of Windows Holographic is on your device in Settings > System > About. “Windows Holographic for Business” will appear if an edition update has been applied to enable Commercial Suite features. Learn how to unlock Windows Holographic for Business features. Windows Configuration Designer (WCD) Create and edit provisioning packages to configure HoloLens via updated WCD app. Simple HoloLens wizard for edition update, configurable OOBE, region/time zone, bulk Azure AD token, network, and developer CSP. Advanced editor filtered to HoloLens supported options, including Assigned Access and Account Management CSPs. IT Pro Center: Configure HoloLens using a provisioning package Configurable setup (OOBE) Hide calibration, gesture/gaze training, and Wi-Fi configuration screens during setup. IT Pro Center: Configure HoloLens using a provisioning package Bulk Azure AD token support Pre-register device to Azure AD directory tenant for quicker user setup flow. IT Pro Center: Configure HoloLens using a provisioning package DeveloperSetup CSP Deploy profile to set up HoloLens in Developer mode. Useful for both development and demo devices. IT Pro Center: Configure HoloLens using a provisioning package AccountManagement CSP Share a HoloLens device and remove user data after sign-out or inactivity/storage thresholds for temporary usage. Supports Azure AD accounts. IT Pro Center: Configure HoloLens using a provisioning package Assigned access Windows assigned access for first-line workers or demos. Single or multi-app lockdown. No need to developer unlock. IT Pro Center: Set up HoloLens in kiosk mode Set up (OOBE) diagnostics Get diagnostic logs from HoloLens so you can troubleshoot Azure AD sign-in failures (before Feedback Hub is available to the user whose sign-in failed). When setup or sign-in fails, choose the new Collect info option to get diagnostic logs for troubleshooting. Local account indefinite password expiry Remove disruption of device reset when local account password expires. When provisioning a local account, you no longer need to change the password every 42 days in Settings, as the account password no longer expires. MDM sync status and details Standard Windows functionality to understand MDM sync status and details from within HoloLens. You can check the MDM sync status for a device in Settings > Accounts > Access Work or School > Info. In the Device sync status section, you can start a sync, see areas managed by MDM, and create and export an advanced diagnostics report.