At 3m19s Greg KH revealed what Mythos did in "revealing" 79 CVEs - pure pattern matching the previous decades of kernel developer's patches, and applying those mechanisms elsewhere to see if they have been universally patched. And Anthropic didn't cite Kernel Developers who original fixed/patched the CVEs like a decent human being would do. So yeah, Anthropic has the same problem OpenAI had for citing original work.
You dismiss "pattern matching" as some sort of trivial thing, so why weren't humans able to apply the same pattern matching to find and fix these defects?
They often were able. Fifteen bugs claimed by mythos were bugs that were already fixed, which the model plagiarized from git history or the kernel mailing list.
> You dismiss "pattern matching" as some sort of trivial thing
I didn't say that - Greg said it in the talk. You interpreted wrong. However, human are a few orders of magnitude slower than agents. Our context windows is definitely less than 1 million tokens (I believe, heck we don't even know how our brain works)
Human brains don’t have a context window. The brain just constantly reconfigures itself on new input. The AI people call this “continuous learning” and believe it’s one of the most important things current AIs are missing.
We do actually know pretty well how the brain works at the level of neurons. We don't know the higher levels of how all of those interactions work to produce certain behaviors.
Cellular neuroscience is a very active research field, and until we actually manage to derive organism behaviours from cellular-level models we won't know that those models are complete enough to do so. We haven't even managed that for C. Elegans, with 959 neurons, let alone humans, with 86 billion.
So we don’t know anything, we can mechanistically dissect any phenomena, but that rarely yields the ability to make interesting or useful predictions, i.e. understanding.
We don't even understand how a single neuron works and are still finding out they have way more connections and connection types than we thought they had.
I think it's safe to say we still have a woefully limited understanding of how the brain works.
By quoting this segment, I inferred that you agreed with Greg.
If you disagree with Greg, then I apologize for inadvertently criticizing you personally.
My point stands, that we're back to debating some metaphysical understanding of what "real intelligence" is when the real standard should be "does it do a better job than humans at this specific task"?
I don't care if the Waymo isn't "truly" intelligent, it drives better than I do, that's a very good thing.
We're all pattern matchers, and if the machine pattern matcher is can find defects and vulns that human pattern matchers can't, that's also a very good thing.
> I don't care if the Waymo isn't "truly" intelligent, it drives better than I do, that's a very good thing.
The funny thing about Waymos is that they seem amazing driving all on their own everywhere until it rains (as it did where I live for the last two days), then they're suddenly nowhere to be seen, because they can't operate correctly in conditions that I've been driving in for my entire life.
devy · · focus · HN ↗
panarky · · focus · HN ↗
ufo · · focus · HN ↗
devy · · focus · HN ↗
I didn't say that - Greg said it in the talk. You interpreted wrong. However, human are a few orders of magnitude slower than agents. Our context windows is definitely less than 1 million tokens (I believe, heck we don't even know how our brain works)
Gigachad · · focus · HN ↗
devy · · focus · HN ↗
Gigachad · · focus · HN ↗
omnicognate · · focus · HN ↗
etdznots · · focus · HN ↗
literalAardvark · · focus · HN ↗
I think it's safe to say we still have a woefully limited understanding of how the brain works.
bendergarcia · · focus · HN ↗
panarky · · focus · HN ↗
If you disagree with Greg, then I apologize for inadvertently criticizing you personally.
My point stands, that we're back to debating some metaphysical understanding of what "real intelligence" is when the real standard should be "does it do a better job than humans at this specific task"?
I don't care if the Waymo isn't "truly" intelligent, it drives better than I do, that's a very good thing.
We're all pattern matchers, and if the machine pattern matcher is can find defects and vulns that human pattern matchers can't, that's also a very good thing.
vips7L · · focus · HN ↗
literalAardvark · · focus · HN ↗
knottn · · focus · HN ↗
miyoji · · focus · HN ↗
The funny thing about Waymos is that they seem amazing driving all on their own everywhere until it rains (as it did where I live for the last two days), then they're suddenly nowhere to be seen, because they can't operate correctly in conditions that I've been driving in for my entire life.
This is a metaphor for AI as a whole.