Comment on AI Is Breaking the Entire Structure of Software That Powers the World: The systems we take for granted are crumbling before our eyes.
You are viewing one comment and its replies. View all comments · View the comment above
You are viewing one comment and its replies. View all comments · View the comment above
Comments
Yes, a 55% false positive rate technically means more often than not, it isn’t actually a valid vulnerability and it is wasting your time. But if you have 1000 boxes to go through while looking for a certain item, someone with a 50% false positive rate could identify two boxes for you, and it would be in one of them.
So unless that number is “AI claims there’s a vulnerability on every other line of code you wrote”, which I kinda doubt, and is actually based on made bug/vulnerability reports, then isn’t is extremely helpful even if it’s only right half the time?
The numbers are based on what happened to curl, since they are transparent about their results, and the ones that weren’t false positives were underwhelming low severity vulnerabilities.
Here’s the report: https://www.vulncheck.com/blog/anthropic-glasswing-november-update
Getting what I’ve seen even the actual vulnerabilities are the sort of stuff that is very very very hard to pull off, like it’s identified a .2ms window where if you input something specific, you break something and gain access. Like race conditions that even though they theoretically exist, they’re actually impossible to execute
Sign in to comment. Sign in