Google Research has released a new website which shows off advancements in its understanding natural language. The new search experiences available through “Semantic Experiences” brings two examples of new capabilities.
The first one introduces an entirely new way to explore books through sentences, called “Talk to Books,” which uses machine learning (ML) and doesn’t rely or has no dependency on keyword matching.
Google claims the models behind the tool are trained on a billion conversation-like pairs of sentences, to identify a good response to the input nased on semantic meaning at the sentence level.
Using the tool is easy, all you need is just ask a question or make a statement to which the tool respond with sentences from books that span over 100,000 books.
Here is an image of new Talk to Books tool:
“Semantris” another ML-powered tool is a word association game that let users enter a word or phrase, and ranks all on-screen words, scoring is based on how they responded to typed ones.
The tool is available in Arcade version allowing to enter in single words as prompts, while the Blocks version has no time pressure.
Also, Google has published a new “Universal Sentence Encoder”, which describes the models used for these examples in more detail.
And, also available is a pretrained semantic TensorFlow module, that let the community to experiment with their own sentence and phrase encoding.
Below is an screenshot of Google Semantris:
On the occassion of the National Pet Day on April 11, Google rolled out updates to Google Assistant and Photos aiming to help pet owners as the Photos app now leverages machine learning to automatically create photo book of your pets.
Additionally, those living in the U.S. or Canada, can also order a hardcover or softcover book.
Recognizing Popular Breeds with Google Lens
Google Lens, which is now built into Assistant and Photos, is now capable of indentifying breeds of cats or dogs. Just take a photo of an animal and use Lens to analyze the photo, and if a match if found, it then pulls a snippet of information about the breed from Google Search.
The feature works on across Android and iOS. You can a GIF animation of it below:
If Google Lens is not able to determine the exact breed, it will instead return a carousel with suggestions of what breed it might be.
Using Google Photos app just go to Assistant tab, and click the movie button, if available choose the “Meow Movie” or “Doggie Movie” option then select your pet, Photos will then compile the best photos with pet-themed music.
Also, you can now label you pets, like cats or dogs to quickly find photos of them. Additionally, photos of pets can also be search by breed, species, or emoji—tryor. See the example GIF below:
This update appears to be rolling out gradually.
Here is a video demonstrating how to create a movie using Photos app: