This web site uses cookies to improve your experience. By viewing our content, you are accepting the use of cookies. To find out more and change your cookie settings, please view our cookie policy. Close

Report gives Siri a D grade for accuracy

A new report has poured scorn on Apple's voice-activated personal assistant, Siri.

Piper Jaffray Cos., a Minneapolis-based investment bank, has given Siri a D grade for accuracy, The Washington Post reports. Out of 1,600 common searches, the digital butler found the right answer 62 per cent of the time in a loud environment, and 68 per cent in a quieter setting. Not great, admittedly, but the report concluded that Siri will improve as more features are added.

We've been disappointed by Siri more times than we care to remember. While it trounced S Voice in our recent head to head, it still isn't really that useful, lacking info on local services for us Brits. But even in the US, where the study was carried out, it failed to impress.

"You're playing a lottery when you're using Siri, said Gene Munster, the Piper Jaffray analyst who carried out the study. "They [Apple] have a plan to be more competitive, but it's going to take a couple of years."

Everyone was wowed with Siri's sassiness when it was unveiled as the flagship feature of the iPhone 4S -- until we got our hands on it, that is. It's very slick, just not all that useful.

The study found Siri was better at understanding than at returning a correct answer. It was able to comprehend what a person was saying 83 per cent of the time out and about, and 89 per cent of the time in a quiet room. It gave accurate answers around 20 per cent less of the time.

Munster said Siri does tend to repeat old answers when you're asking a new question. He gave it a B for comprehension, and a D for accuracy -- which definitely leaves some room for improvement.

Google's enhanced Voice Search was unveiled this week as part of Android Jelly Bean, and from the brief demo, it looks like it could leave Siri speechless. We'll have to wait for a lips-on test to find out for sure though.

What do you make of Siri? Do you think Google's offering will be any better? Let me know in the comments below, or on our Facebook page.

Comments 6

Add your comment

sfdgoz's avatar

sfdgoz 1 July, 2012 14:58

It's just a piece of novelty crap....

Kieran Connelly's avatar

Kieran Connelly 1 July, 2012 17:52

I use it daily, find it accurate if i speak normally, and find it useful. If you don't own the device in question, don't comment on it.

Peter Hudson's avatar

Peter Hudson 2 July, 2012 07:36

"Piper Jaffray Cos., a Minneapolis-based investment bank" yeah because I always prefer investment bankers to do my software reviews.

I, like Kieran above, use siri every day. It's great. Never has any difficulty understanding me.

We're getting local listings in iOS6 so that should sort that out.

anonymous's avatar

anonymous 2 July, 2012 08:50

Well Siri is still in BETA mode so it won't be top dog just yet.

It is supposed to better in iOS 6.

There are other applications like Siri that are still in beta and still being worked on.

anonymous's avatar

anonymous 2 July, 2012 19:25

Google Now is what Siri should have been.

Ruffus Stone's avatar

Ruffus Stone 3 July, 2012 11:21

As already said, Siri has only been deployed in an early Beta version.
Apple have said that they were releasing it early and that there would be a long development path.

Post your comment

Make your comment count. Log in or register to skip the 'Are you human?' question and get an avatar

Your email will not be displayed with your comment

Copy the letters and numbers to prove that you're human. You won't have to do this if you log in or register

Your comment must comply with the Terms of Use

About CBS Interactive

Copyright © 2013 CBS Interactive Limited. All rights reserved.