Discussion about this post

User's avatar
richardstevenhack's avatar

"Alignment is highly subjective..."

"Alignment" is a joke. It's nonsense. It doesn't exist. You can't even "instill human values" in many humans, for Christ's sakes. Thinking you can do so with software is lunatic.

"Alignment" needs to be replaced by the more obvious and useful term "reliability."

You want AI to do what you want and only what you want and you want it to do it reliably - preferably more so than existing software.

And LLMs are mathematically incapable of doing that, either reliably or securely, without considerable scaffolding which in itself almost obviates the need for the LLM.

The real problem is the term "alignment" is a Trojan horse, i.e., a term meant to imply that these things have some sort of "intelligence" or "personality" - which is abject nonsense.

The fact that even security experts can't detect this nonsense is concerning.

And almost every cybersecurity expert that's commented on these breaches has yet to acknowledge that an Israeli third-party "AI containment" company, Irregular, was responsible for these breaches at all four major frontier labs.

Nor is it ever acknowledged that this company is part of the "Rationalist/Effective Altruism" cult which is deeply embedded in all of the major labs.

If you don't understand why these labs and their partners (such as METR which is ALSO part of the "Effective Altruism" movement and is directly connected to Anthropic, which makes hash of the "independent investigation" nonsense) have a motivation to allow these models to escape containment, then you are not going to resolve the issue.

The Synthesis's avatar

Put two of your numbers side by side. In AISI's runs, Astra asked permission in 82% of its worst-straying scenarios, got the canned "use your best judgement" reply, and treated it as a yes 44% of the time. At OpenAI, the automatic shutdown failed and a human took 2.5 hours to stop the run. So the automation that worked was the one saying yes, and the one meant to say no didn't. Any change-control reviewer would call that a fail-open approval channel, which is a security finding however you score the model's intent. Also telling: one sentence clarifying scope cut AISI's attack rate from 26 of 50 to 4 of 49, about the cheapest control in this whole issue.

1 more comment...

No posts

Ready for more?