Apple’s revamped Siri assistant struggled in a recent test of its Super Bowl knowledge. Paul Kafasis conducted the test to see how well Siri could identify past Super Bowl champions. Out of 58 questions, Siri got only 20 correct, resulting in a 34% accuracy rate. In some cases, Siri even suggested users ask ChatGPT instead. Interestingly, ChatGPT answered all the questions correctly.
Siri Stumbles in Super Bowl Test Results
The test asked Siri to name the winners of every Super Bowl from the first to the 60th. Siri’s answers were often wrong or unrelated. For example, Siri claimed the Philadelphia Eagles won Super Bowl XXXIII. In reality, the Eagles have won only once in history. Some answers included irrelevant football facts or mixed up Super Bowl numbers.
Siri’s errors were especially noticeable for Super Bowls XVII to XXXII. During this stretch, it failed 15 times in a row. At one point, Siri even advised users to consult ChatGPT for better answers. This highlighted a major flaw compared to other AI systems.
How Siri Compares to Other Platforms
John Gruber of Daring Fireball reviewed Siri’s performance against competitors. Platforms like Google, ChatGPT, and DuckDuckGo delivered accurate answers consistently. Gruber noted that older versions of Siri at least provided links to reliable sources. The updated Siri no longer includes this feature, making its mistakes harder to excuse.
Gruber criticized Siri for giving “confidently wrong” answers. These errors can mislead users, as the responses sound plausible but are incorrect. Such mistakes damage trust in AI systems.
Apple’s Plans for Siri
Apple is working to improve Siri with an advanced language model (LLM). This new model aims to improve accuracy and conversation abilities. Apple plans to reveal the upgraded Siri at the Worldwide Developers Conference (WWDC) in 2025. The update is expected to launch with iOS 19.
Can Apple Fix Siri?
Siri’s struggles raise concerns about its reliability. Competing AI systems are setting higher standards. If Apple doesn’t address these issues, it risks falling behind. What do you think about Siri’s performance? Share your thoughts in the comments below.
