Yesterday I tried to google "can the Halifax Wanderers still make the CPL playoffs?"
So obviously what appears right at the top is the AI summary, which told me "they've already secured their #4 position and made the playoffs". I knew this wasn't true, and I guess I could have just scrolled down a bit further and found my answer but now I was curious.
So I said "that's not true, they're still #5, what I want to know is _could they still make the playoffs_"
It says they've got an upcoming game against Ottawa, and if they win their chances are good. That game has already taken place, so I correct it again and finally I get a reasonable answer.
My question is: what's the point of the AI in the search engine if it itself isn't going to use the search engine first before answering? Like, I can't wrap my head around that. The answer is on the same page as its hallucination. It could have done a cursory look around before first hallucinating something completely false, and when corrected the first time giving me outdated information. It's meant to be A SEARCH ENGINE!
This is similar to how, not too long ago, LLM's had extreme difficulty counting the number of letters in some words. LLM's don't "think" or "reason" in the normal definition of those terms. They can do some pretty amazing things, but still screw up basic things like telling you something that is obviously wrong and contradicts the top search results.
LLM's, in their present stage of development, are sort of like a crack-addled idiot savant. Sometimes they are obviously insane, and sometimes they seem quite cogent, but you must never trust them implicitly. This may be why they are so difficult to constrain. You could give them something equivalent to the laws of robotics, but following laws requires thought processes they simply don't have.
I'm actually sort of amazed Google doesn't make people accept some kind of butt-covering EULA and post disclaimers about the inaccuracy of results before even showing you their AI's output. Are they not being sued over this kind of thing?
> LLM's, in their present stage of development, are sort of like a crack-addled idiot savant. Sometimes they are obviously insane, and sometimes they seem quite cogent, but you must never trust them implicitly.
I have nothing to add. Just wanted to save this quote for posterity. Thank you.
Then again, have you ever asked a golden retriever about CMake errors? Rubber ducking is a real thing, after all. Besides, a golden retriever would be a good morale boost if nothing else.
ML in general is alien to how we think of intelligence.
The closest I can make a biology analogy, is if someone had an immortal and congenitally-brain-damaged large rodent, and mapped tokens to different scent molecules, and spent 800,000 years training it on how well it could imagine the next smell in the sequence before even considering making it conversational.
Yes, it can do a lot.
But also, it took a long "subjective" (if it even has that) time to get there; and despite it being really bad at learning from examples, it is pretty surprising that such a small brain was even capable of learning so much at all, even though it had an effectively unbounded (by biological standards) amount of time spent on that training.
Hugsbox · · focus · HN ↗
So obviously what appears right at the top is the AI summary, which told me "they've already secured their #4 position and made the playoffs". I knew this wasn't true, and I guess I could have just scrolled down a bit further and found my answer but now I was curious.
So I said "that's not true, they're still #5, what I want to know is _could they still make the playoffs_"
It says they've got an upcoming game against Ottawa, and if they win their chances are good. That game has already taken place, so I correct it again and finally I get a reasonable answer.
My question is: what's the point of the AI in the search engine if it itself isn't going to use the search engine first before answering? Like, I can't wrap my head around that. The answer is on the same page as its hallucination. It could have done a cursory look around before first hallucinating something completely false, and when corrected the first time giving me outdated information. It's meant to be A SEARCH ENGINE!
beloch · · focus · HN ↗
LLM's, in their present stage of development, are sort of like a crack-addled idiot savant. Sometimes they are obviously insane, and sometimes they seem quite cogent, but you must never trust them implicitly. This may be why they are so difficult to constrain. You could give them something equivalent to the laws of robotics, but following laws requires thought processes they simply don't have.
I'm actually sort of amazed Google doesn't make people accept some kind of butt-covering EULA and post disclaimers about the inaccuracy of results before even showing you their AI's output. Are they not being sued over this kind of thing?
baubino · · focus · HN ↗
I have nothing to add. Just wanted to save this quote for posterity. Thank you.
_kb · · focus · HN ↗
If you apply the dogs on acid mental model it helps establish appropriate levels of trust.
SV_BubbleTime · · focus · HN ↗
sham1 · · focus · HN ↗
ben_w · · focus · HN ↗
The closest I can make a biology analogy, is if someone had an immortal and congenitally-brain-damaged large rodent, and mapped tokens to different scent molecules, and spent 800,000 years training it on how well it could imagine the next smell in the sequence before even considering making it conversational.
Yes, it can do a lot.
But also, it took a long "subjective" (if it even has that) time to get there; and despite it being really bad at learning from examples, it is pretty surprising that such a small brain was even capable of learning so much at all, even though it had an effectively unbounded (by biological standards) amount of time spent on that training.
Melatonic · · focus · HN ↗
JSR_FDED · · focus · HN ↗
_kb · · focus · HN ↗
tripzilch · · focus · HN ↗