Deep Shop is a Google Research project on migrating tasks across devices using mobile phone cameras.
"In a project named Deep Shot, we demonstrated how a user can easily move web pages and applications, such as Google Maps directions, between a laptop and an Android phone by using the phone camera. With Deep Shot, a user can simply take a picture of their monitor with a phone camera, and the captured content automatically shows up and becomes instantly interactive on the mobile phone," stated google.
"This project was inspired by our observations that many people tend to take a picture of map directions on the monitor using their mobile phone camera, rather than using other approaches such as email. Taking pictures feels more direct and convenient, and fits well our everyday activity that is often more opportunistic. Instead of just capturing raw pixels, Deep Shot recovers the actual contents and applications on the mobile phone based on these pixels," noted Google.
"Similar to WYSIWYG--What You See Is What You Get--for graphical user interfaces, Deep Shot demonstrates WYCIWYG--What You Capture Is What You Get--for cross-device interaction. We are exploring this interaction style for various task migration situations in our everyday life," google explains.
You can find out how Deep Shot keeps user interaction simple and what happens behind the scenes in the research paper embedded below.
[Source: Research Blog]