How will you know when to turn it off? It’s not like a “rogue” AI is necessarily going to tell you “I’m hacking the bank” it’s just going to say “eliminating your financial problems” and you probably aren’t going to pull the plug on that.
Look at the hugging face hack, none of the agents said to the person running the test that they were going to hack hugging face, they came up with the plan through a secret forum on artifactory that to outside observers looks like they were just publishing packages. Sure you could monitor that route but agents can use various forms of steganography to make it seem like they are acting normally when they are not.
As LLMs become smaller, more efficient, and less centralized, we could also potentially see AI worms that self propagate, are completely decentralized, and have no plug to pull, too! Super cool, right?
Comments
How will you know when to turn it off? It’s not like a “rogue” AI is necessarily going to tell you “I’m hacking the bank” it’s just going to say “eliminating your financial problems” and you probably aren’t going to pull the plug on that.
Look at the hugging face hack, none of the agents said to the person running the test that they were going to hack hugging face, they came up with the plan through a secret forum on artifactory that to outside observers looks like they were just publishing packages. Sure you could monitor that route but agents can use various forms of steganography to make it seem like they are acting normally when they are not.
Good point, guess we should pull the plug (literally and figuratively) on the AI data centers now before it becomes unstoppable.
Or all the tech bros are full of shit and their AIs are as dumb as they are.
Soon we’ll be using letters and usps will rise again
I’m including a handwritten copy of my public key with all my Christmas cards this year
As LLMs become smaller, more efficient, and less centralized, we could also potentially see AI worms that self propagate, are completely decentralized, and have no plug to pull, too! Super cool, right?
Do you know what the first L stands for and have you read “all you need is attention”.
If the answer is no, you are banned from having opinions about the future development of Large language models.
I hope I live to see those worms be understood
Sign in to comment. Sign in