Yesterday I tried to google "can the Halifax Wanderers still make the CPL playoffs?"
So obviously what appears right at the top is the AI summary, which told me "they've already secured their #4 position and made the playoffs". I knew this wasn't true, and I guess I could have just scrolled down a bit further and found my answer but now I was curious.
So I said "that's not true, they're still #5, what I want to know is _could they still make the playoffs_"
It says they've got an upcoming game against Ottawa, and if they win their chances are good. That game has already taken place, so I correct it again and finally I get a reasonable answer.
My question is: what's the point of the AI in the search engine if it itself isn't going to use the search engine first before answering? Like, I can't wrap my head around that. The answer is on the same page as its hallucination. It could have done a cursory look around before first hallucinating something completely false, and when corrected the first time giving me outdated information. It's meant to be A SEARCH ENGINE!
The other day, it was the Aussie AFL final. We were in the car and asked it for a score update.
"The team are tied at the end of the third round with the scores 43 to 51".
So it was tied at the end of round 2 for 43, not round 3. Not sure were it got the 51 from and why it figured it was a tie. LLM's pretty cool until they aren't. As they say, the hallucinate 100% of the time but most of the time it is useful.
You're experiencing how LLMs predict left to right. It would never have said "at the end of the third round the scores are 43 to 51 and the teams are tied" but it painted itself into a corner by saying there was a tie first, presuming the numbers are real.
Hugsbox · · focus · HN ↗
So obviously what appears right at the top is the AI summary, which told me "they've already secured their #4 position and made the playoffs". I knew this wasn't true, and I guess I could have just scrolled down a bit further and found my answer but now I was curious.
So I said "that's not true, they're still #5, what I want to know is _could they still make the playoffs_"
It says they've got an upcoming game against Ottawa, and if they win their chances are good. That game has already taken place, so I correct it again and finally I get a reasonable answer.
My question is: what's the point of the AI in the search engine if it itself isn't going to use the search engine first before answering? Like, I can't wrap my head around that. The answer is on the same page as its hallucination. It could have done a cursory look around before first hallucinating something completely false, and when corrected the first time giving me outdated information. It's meant to be A SEARCH ENGINE!
FlowingRiver · · focus · HN ↗
"The team are tied at the end of the third round with the scores 43 to 51".
So it was tied at the end of round 2 for 43, not round 3. Not sure were it got the 51 from and why it figured it was a tie. LLM's pretty cool until they aren't. As they say, the hallucinate 100% of the time but most of the time it is useful.
someonebaggy · · focus · HN ↗