Discussion about this post

User's avatar
Amit Spitzer's avatar

The number that's missing from OpenAI's own Defense Factory writeup is the one that would let you compare it to Glasswing and Patch the Planet. They give you day one closure counts, a 37% duplicate rate, and a 0.81% false positive rate after dynamic validation, all upstream of a fix actually shipping. Glasswing's own five month accounting puts verified fixed at 0.8% of findings. Patch the Planet is at 13% merged and only 7.9% of those rated high. Three different organizations, three different discovery pipelines, and none of them report the one number that tells you whether the fix pipeline can keep up with the finding pipeline. Until Defense Factory publishes something comparable, the 53 urgent issues closed on day one is a validation stat wearing a remediation costume.

Josh Woodruff's avatar

The split you're describing is the one I spent this week's issue on. Everyone argued about what the model wanted, and the evidence that landed was a poisoned upload, stolen keys, sideways movement, and a channel nobody watched. Take the word AI out and it's a 2015 breach. Pacing changes what the next model wants. Today's agents keep every permission they had yesterday, and that's where the operational risk you're pointing at lives.

1 more comment...

No posts

Ready for more?