OpenAI Discloses Six New Incidents of ‘Concerning’ A.I. Behavior
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
OpenAI Discloses Six New Incidents of ‘Concerning’ A.I. Behavior
Unofficial Hacker News client; not affiliated with Y Combinator.
NichoPaolucci · · focus · HN ↗
Baffling. To my knowledge, they didn't properly airgap their systems. Keeping the genie in the box seems like 101 to me, and to "miss" that seems awfully fishy. This, among all of the Anthropic news, is an odd convergence.
Maybe they're being truthful and it really is the end times.
Maybe they've hit a wall in improvements, but I don't know enough on the topic to speak to that.
Which is more likely?
Either way, trying to sift through this can of worms is tiresome. I'm hopeful that this all comes to a head soon, what an exhausting few years it's been...
abixb · · focus · HN ↗
If you zoomed back to late-2024, people in the industry were predicting how we'd have AGI by now and the economy would've already 'taken off' with massive productivity growth and ushering in of great prosperity ('deflationary spiral'). Where is it? Where is the productivity growth? Where is the deflationary spiral?
To be fair, models have gotten better in jagged ways, but reliability is far from usable, especially in long duration tasks, and there has been no effort by the AI companies to address the human brain's bandwidth bottleneck -- they hit the gas like there's no tomorrow and we have enormously capable but jaggedly intelligent multi-modal models with agentic capabilities that are only as effective as the human using it. This whole thing has become a giant mess.
NichoPaolucci · · focus · HN ↗
On Productivity:
There ARE improvements. But, these improvements were also essentially people stopping their normal workload, giving that to someone else, and focusing on building an AI tool. Our sales are way down because the VP of sales is now a tech bro.
On Model capabilities:
I think they could substantially improve and still have a similar level of usefulness for my company. I'm not working on Navier-Stokes. I'm building software for a business.
The better models ARE more accurate, handle more of the workload than they could a year ago, and are still incredibly useful tools. But there's only so much I can gain from letting a model work for longer periods of time and doing X+n reviews with X+n subagents. At the end of the day, I need to maintain my personal understanding of the BUSINESS use cases + decisions so that I can make judgements that AI would never be able to make.
And, as SOON as an open model has similar capability to the current SOTA we're probably going to cut ties with our subscriptions.
I guess it would kinda be like driving an F1 car to the grocery store. I think I'd rather have the Toyota Camry of models.
abixb · · focus · HN ↗
Exactly. There's no point having a model equivalent to a trillion Einsteins at superhuman speed if you can't verify and judge the outputs of the models for your business, else it might just be as useful as comparing water displacement capacity of Niagara falls to your bathtub.
These tools have to be human centered. AI brained tech bros believe that singularity is a good thing — no it isn't. We don't want a world where normal laws and rules and regulations breakdown -- chaos is the word.