Apple analyst Gene Munster published a note to clients of his finding involving 1600 questions, asked to iPhone to know how Siri Apple's iPhone 4S voice assistant stacked up against new Anroid 4.1 (Jelly Bean) Google search.
"Built from the ground up in the Android 4.1 (Jelly Bean) update, the new search engine accepts and answers questions with aplomb."
In the test, both Google and Siri were asked 800 questions on the busy streets of Minneapolis, and rest 800 in a quiet room, reports Fourtune's Phillip Elmer-DeWitt.
Per Piper Jaffray's published results: hursday in a note to clients:
- Google understands 100% of the questions (not surprisingly, since they are keyed in)
- Google replies accurately 86% of the time
- Siri comprehends 83% of queries in noisy conditions, 89% in a quiet room
- Siri answers accurately 62% of the time on the street and 68% in a quiet room.
DeWitt wrote, that Munster estimates that Siri is more than two years behind Google in its learning curve. But he's optimistic, and noted, "With the iOS 6 release in the fall, we expect Siri to improve meaningfully while reducing its reliance on Google from 60% to 48%."
He further notes, that currently "Siri gets 60% of its answers from Google, 20% from Yelp, 14% from WolframAlpha, 4% from Yahoo and 2% from Wikipedia."
"Breaking down Siri's reliance further," Munster writes, "Google provides 100% of navigation results, 61% of information results, 48% of commerce results and 42% of local results. Among other result aggregators, Yelp provided the most local results (51%) and commerce results (51%), while WolframAlpha provided 34% of information results."
"In order to become a viable mobile search alternative," Munster writes, "Siri must match or surpass Google's accuracy of B+ and move from a grade D to a B or higher."
In the video below, Technobuffalo tested the two's voice capabilities, "When we first booted it up and gave it a go, it seriously blew us away with how quick it returned results, and the technology's voice is much more fluid than Siri's robotic pipes. We pitted the two against each other to see just how great Google's enhanced search is, and why Apple's new Siri may already be behind before she even arrives," writes Technobuffalo.