Eye Control Now Part of Windows 10 Insider Preview Build 16257 & 15237 for PC /Mobile

Eye Control beta rolls out to Windows Insiders Preview Build 16257 for PC in the Fast ring.

Share online:

Turn on Eye Control under Settings app on build 16357

Windows Insiders in the Fast ring on Wednesday received a new build 16257 with an exciting new accessibility feature, along with build 15237 released to Windows Mobile Insiders in the Fast ring.

The new Eye Control beta, which empower people with disabilities to access Windows 10 more easily using their "eyes," enable them to operate an on-screen mouse, keyboard, and text-to-speech. It's currently only support EN-US keyboard, with support for more layouts will be available in the future.

To set up the new experience and unlock access to Windows operating system, you require a compatible eye tracker, like Tobii Eye Tracker 4C. Soon, support for Tobii Dynavox PCEye Mini, PCEyePlus, EyeMobile Plus, and I-series, will be available, too.

Next up, download and update Tobii's Core eye tracking hot fix release 2.10.11.6458, and run calibration with your profile

  • Check and update to Tobii Eye Tracker HIDClass Driver on Windows Update
  • Now, connect Tobii eye tracker to PC and turn on Eye Control by going to Settings -> Ease of Access -> Other Options -> Eye control.

    Once enabled, the Eye Control launchpad will appear on-screen, and provides access to mouse, keyboard, text-to-speech. You can also reposition the UI to opposite side of the screen. To interact with Eye Control UI, simply look at the UI until the button activates, and a visual affordance will soon appear around the UI.

    • To use a on-screen mouse, select it from the launchpad, "simply position your eyes on the screen you want the cursor to be placed, fine tune the position, and select what action you want to take (left click, double left click, right click, or cancel)."
    • Eye Control mouse
      Eye Controling mouse

    • Eye Control on-screen keyboard by selecting it from the launchpad, "dwell at the characters to type."
    • Type faster with "shape writing" on the on-screen Eye Control keyboard—simply, "turn it on from the keyboard settings on the Fn page," then, "form words by dwelling at the first and last character of the word, and simply glancing at letters in between." A predicted word will appear on the last key of the word, simply select an alternative prediction, when an incorrect hint appears.
    • Eye Control on-screen keyboard and shape writing
      Eye Controling keybaord and shape writing

    • Eye Control text-to-speech – Communicate with your family and friends in person by using text-to-speech.
    • To use text-to-speech, select text-to-speech from the launchpad, and start typing sentences on-screen keyboard and have it spoken aloud. To change default text-to-speech voices, go to Settings -> Time & Language -> Speech -> Text-to-speech.
    • At the top are phrases spoken aloud immediately and can be edited to say different words.

    To adjust the dwell times, turn on/off shape-writing, and turn on/off the gaze cursor used to test hardware calibration, just go to Eye Control settings on Fn keyboard page.

    Eye Control settings fn page
    Eye Control settings fn page

    Additionally, Microsoft Edge received improvement like, "Acrylic," which is now part of the new Fluent Design System. And, the Windows Console's default colors have been changed to support full 24–bit RGB color, improving legibility of darker colors on modern screens, and providing the Console a more modern look & feel.

    The use of Acrylic material provides more modern look, depth and transparency to the tab bar and other controls. Also, improved are button animations to feel more responsive and delightful.

    Microsoft Edge Acrylic material design
    Microsoft Edge Acrylic material design

    This new color scheme will be visible only in Properties, when clean installed this build.

    In addition, Windows Insiders, who are also Office Insiders will now be able to incorporate 3D objects in Word, Excel and PowerPoint. "Easily insert a 3D object from the Remix 3D catalog or your PC, change its perspective and use transitions like Morph in PowerPoint to create cinematic animations between slides to bring 3D objects in your presentations to life," writes Dona Sarkar.

    In the latest .future podcast, we look at how inclusive design is making technology work better for everyone. It features Jenny Lay-Flurrie and Sean Marihugh from Microsoft, as well as Angela Glover Blackwell, the founder and CEO of PolicyLink, and Dan Hermosa, a design consultant and professor.

    Here are the full changes in build 16257 and 15237.

    For PC build 16257

    • Based on your feedback we've adjusted the design of the address bar so now even if the address bar isn't in focus to start with when you click and drag the text it will remain under the cursor. Previously the text would shift as the "http://" appeared – this change will make it easier to quickly edit parts of the URL.
    • We fixed an issue where right-clicking on an image in Microsoft Edge and selecting copy then later pasting the clipboard content would result in the image URL being pasted rather than the image itself.
    • We fixed an issue where if a tab had been opened while Microsoft Edge was in full screen mode, using Ctrl + W to close that tab while still in full screen mode would close the content but leave the tab in the frame.
    • We fixed an issue where if you had two unrelated tabs in Microsoft Edge and opened a link from the first in a new tab, the new tab would appear to the right of the second tab rather than the first.

    Input Improvements

    • We've improved the performance of launching the touch keyboard after tapping the touch keyboard button in the taskbar.
    • We fixed an issue where using WIN+H to dictate into a UWP app's text field wasn't working.
    • We fixed an issue resulting in the Japanese IME prediction candidates position being shifted and overlapping with typed text if you set the page zoom level to something other than "100%" in Microsoft Edge.
    • We've adjusted the design of the Japanese curve-flick touch keyboard to display numbers and English letter keys in a smaller font that's more consistent with the size of the Japanese character keys.

    Windows Defender Application Guard (WDAG) Improvements

    • We have added new status strings to the WDAG splash dialog to provide more information about the startup stages for WDAG. These new strings will be displayed to users when WDAG is starting up and when it's being resumed from a paused state.
    • We have also made significant improvements to container launch times by optimizing background preparation of the WDAG container.
    • We fixed a number of issues that were impacting networking inside the WDAG container as well as a poor user experience when connecting to the WDAG container.
    • Fixed an issue where the WDAG launch resulted in Error Codes 0x02 / 0x00 or 0x02 / 0c.
    • Fixed an issue where only part of the WDAG window was being displayed after launch.
    • Added a registry key to allow users to optimize WDAG launch times during active browsing by not suspending the WDAG container when the WDAG window is closed. You can set the registry key to optimize for performance here: Computer\HKLM\Software\Microsoft\HVSI\, Value name: SuspendOnContainerClosed, REG_DWORD, Value data: 1. Note: Setting this key will result in the container not pausing and the container will not release committed memory.

    General changes, improvements, and fixes for PC

    • We fixed an issue where the battery flyout might have shown unexpected text for the % charged (specifically "%1!s!%2!s!% until fully charged").
    • We've fixed an issue resulting in certain network setting being lost on upgrade and reverting to default. Specifically, static IP address configuration was reverted to DHCP, and networks marked private were reverted to public.
    • If you had installed Builds 16226-16237 and had found Storage Spaces to not be working, today's build expands upon the fix in 16241 to remediate those PCs that had upgraded from the impacted build range and were still in a bad state. Thanks again to the Insiders that have helped us investigate this!
    • We fixed an issue where if you switched to a new tab and back in Microsoft Edge, Narrator would start reading from the top of the page again, rather than remember where you had been on the page.
    • We fixed an issue where right-clicking on a folder in File Explorer and saying Scan with Windows Defender wouldn't work if the folder name contained #.
    • We fixed a rare issue where the Windows Search Service might get stuck on initialization after upgrade, resulting in File Explorer showing "Working on it…" infinitely when accessing certain folders.
    • We fixed an issue resulting in certain games such as Wargaming's World of Tanks, World of Warships, and World of Warplanes appearing to hang/freeze shortly after launch when played on x86 PCs in recent flights.
    • We fixed an issue where some Insiders were not being offered builds higher than Build 16241.
    • We fixed an issue where connecting to a VPN using a solution downloaded from the Windows Store may result in a system crash.

    Known issues for PC

    • Eye tracking does not work well in direct sunlight. The device may require new calibration when moving to a location with different lighting conditions.
    • The launchpad partially blocks the Tobii UI during device calibration. To work around this, turn off Eye Control during calibration and turn it back on when you are done. You can also use touch or mouse to reposition the UI during calibration.
    • Sometimes shape-writing can get stuck on. You can fix this by dwelling at the shape-writing icon to turn it on and off again
    • Sometimes the reposition UI icon in the launchpad takes focus after exiting text-to-speech
    • Start, Action Center and notification toasts may at times have a background that is 100% transparent. A fix will be available in later flight – for now, if you encounter this issue, try ending ShellExperienceHost.exe via Task Manager or rebooting to resolve the issue.
    • We're investigating reports where Action Center shows it has some number of notifications but when you click to open Action Center, there are no notifications shown.
    • We're investigating reports that suggested apps are visible in Start despite the related setting being off. For now, if you encounter this please try toggling Settings > Personalization > Start > "Occasionally show suggestions in Start".
    • When installing or updating a Windows Store app, you may see error 80070057. As a workaround, you can get the latest app by uninstalling the older version of the app from your device and reinstall latest version from Store.

    General changes, improvements, and fixes for Mobile

    • We made some improvements to the Field Medic Store app, where we fixed an issue with collecting Watson crash data, enabled spell checking when editing a report, and updated the PowerOn/PowerOff profiles to include additional battery info.
    • We fixed an issue where the screen would occasionally flash black after launching or rotating the Camera app.
    • We fixed an issue with the HP Elite X3 reporting that the SD card had been removed from the device when it had not.
    • We fixed an issue with Continuum where, after the attached monitor is unplugged, occasionally the mobile LCD does not power off and the mobile battery could be drained.
    • We fixed an issue with the Windows inbox NFC driver where occasionally the wrong card type data was reported.
    • We improved the Cortana resume-from-suspend behavior to enable a Cortana skill to be authenticated before the user interacts with the skill.
    • We fixed an issue with the behavior of the hardware search button in countries where Cortana is not available. In this case, the OEM provides the search app or URI.

    Known issues for Mobile

    • There is a problem with the HP Elite X3 with wired docks where the portrait orientation setting is lost when the external display is disconnected and reconnected. A workaround for this is to reboot the phone after tapping the "OK" button instead of disconnecting and reconnecting. This workaround must be performed every time you connect to an external display you want to use with Continuum in portrait orientation.
    • If you have apps saved to your SD card, you may see error 8007000B when trying to update those apps. As a workaround, you can move these apps to internal memory, update them, and then move them back to your SD card. Thank you to all the Insiders who reported this to us!
    • When installing or updating a Windows Store app, you may see error 80070057. As a workaround, you can get the latest app by uninstalling the older version of the app from your device and reinstall latest version from Store.