• 16 Posts
  • 8 Comments
Joined 2 years ago
cake
Cake day: October 15th, 2023

help-circle










  • This was a very poorly conducted study. Every single tester was a journalist from the very companies losing traffic to AI. They had a direct stake in making the results look bad. If you dig into the actual report, you see how they get the numbers. Most of the errors are “sourcing issues”: the AI assistant doesn’t cite a claim, or it (shocking) cites Wikipedia instead of the BBC.

    Also, the models are heavily outdated (4o for GPT, Flash for Gemini, which aren’t even equivalent in intelligence). They don’t list the full model versions from what I can tell.