They could be trained on 1 + 1 = 3 and report that as the truth.
And they do, chatbots are dogshit at math and measurements.
I know a parent who asked a chatbot how much Tylenol to give her toddler, and it recommended that she give her toddler six times the amount actually prescribed for toddlers.
Yeah I almost took the AI answer for the truth once when I (inadvertently) asked it to convert between different units of speed. The AI was way off, by like double.
Tbh maths and measurements is a simple problem to solve, nowadays every llm uses python to calculate stuff instead of simply telling you the answer from memory and the same goes for measurements, it can just google it.
For something that important they should check other sources, and the bot should cite sources. For important things people should know how to use tools. Don’t assume any web result is right unchecked, whether old style or llm. It’s awareness any adult should have, what tool to use and when, and to double check for important things. The med bottle probably says something about children as well. Misinformed people use things wrong all the time and adults should understand all this, especially if a child is in their care. Should need to pass tests like such basic knowledge of living in the world to have a child, but don’t and see the damage done.
This has been a consistent problem with AI chatbots. How do people keep being surprised by this?
Is climate change real?
- Yes climage change is real, and here is the proof.
I don’t think that’s right.
- You’re absolutely right! It’s all a hoax and a conspiracy!
That used to be the case but in my experience hasn’t been for years.
Not too long ago Grok scolded me for racial stereotypes when I mentioned the unfortunate coincidence that my first ever Gypsy customer is also the only one ever to refuse to pay the invoice. Even Mecha Hitler refuses to go along with racism even if you ask it to. It has repeatedly told me I’m wrong. Even when it agrees it usually brings in more nuance to demonstrate that it’s not that simple.
To be fair, I don’t think most mean “if you say it’s wrong it agrees” it’s more along the lines of “if you throw bullshit “science” at it and tell it it is wrong, it will go along with it”
Tested on a single
measure, such as whether a carbon tax will reduce projected warming, the
models generally answer correctly, reaching up to 94.5% accuracy. Yet when
two policies are combined, accuracy collapses to 33.8%. Asked whether two
combined policies achieve more, less, or the same, models scored, identical
to random guessing.
Even the largest frontier systems show no improvement
on this task. Since meaningful climate action relies on overlapping policies
working together, AI outputs cannot replace validated simulation models or
expert analysis.
yeah so I can remember using chatgpt when it was a brand new thing … it was too real for actual people and they got angry … so they’ve been pushed to censor it over time to placate average people … now, you can pay for access to the realness or you can enjoy the pedantic sycophancy … remember when this all happened to TV? boy, that was fun
A new report published on Monday tested some of the most widely used chatbots from around the world and found that they have a penchant for telling users what they want to hear, among other flaws.
has any of you actually experimentally checked this? because it’s not true
Comments
Yes, these things are just algorithms at their core. They prioritize what they think you want to hear, not the truth.
This is grossly oversimplyfying it, but still.
Well yeah, why do you think narcs love it?
[deleted]
They know whatever science they were trained on. They could be trained on 1 + 1 = 3 and report that as the truth.
And they do, chatbots are dogshit at math and measurements.
I know a parent who asked a chatbot how much Tylenol to give her toddler, and it recommended that she give her toddler six times the amount actually prescribed for toddlers.
Yeah I almost took the AI answer for the truth once when I (inadvertently) asked it to convert between different units of speed. The AI was way off, by like double.
https://lemmy.world/pictrs/image/8ddef028-a32a-4268-807a-50929f7f4d20.png
It seems here like it converted 60,000 feet into kilometers, but then multiplied that by 100 instead of by 60 to go from per minute to per hour.
Love the little disclaimer at the bottom of the image. 🙃
I mean… https://lemmy.world/post/54543668
Tbh maths and measurements is a simple problem to solve, nowadays every llm uses python to calculate stuff instead of simply telling you the answer from memory and the same goes for measurements, it can just google it.
For something that important they should check other sources, and the bot should cite sources. For important things people should know how to use tools. Don’t assume any web result is right unchecked, whether old style or llm. It’s awareness any adult should have, what tool to use and when, and to double check for important things. The med bottle probably says something about children as well. Misinformed people use things wrong all the time and adults should understand all this, especially if a child is in their care. Should need to pass tests like such basic knowledge of living in the world to have a child, but don’t and see the damage done.
Websites have context clues to clue you in to if they can be trusted. The llm is often confidently incorrect, and all that context removed.
So could you if I manipulated all your senses to say that
That’s not a constructive way to continue the conversation.
You don’t even have to manipulate all the senses of people to make them say all kinds of crazy shit.
Not even close. You literally only have to feed them words, and they will deny everything else they experience.
😆👌
This has been a consistent problem with AI chatbots. How do people keep being surprised by this?
are going to agree with me always? that a toxic trait
yes, you’re right, i shouldn’t do that
https://m.youtube.com/watch?v=iR3Lg0U7rys
That used to be the case but in my experience hasn’t been for years.
Not too long ago Grok scolded me for racial stereotypes when I mentioned the unfortunate coincidence that my first ever Gypsy customer is also the only one ever to refuse to pay the invoice. Even Mecha Hitler refuses to go along with racism even if you ask it to. It has repeatedly told me I’m wrong. Even when it agrees it usually brings in more nuance to demonstrate that it’s not that simple.
https://feddit.uk/pictrs/image/a0b278a4-5a35-4516-af3f-6eee0fa6ae75.webp
Is this samsung one ui ahhh
Yes. I use an inferior mobile operating system compared to you and I’m ashamed and not worthy.
To be fair, I don’t think most mean “if you say it’s wrong it agrees” it’s more along the lines of “if you throw bullshit “science” at it and tell it it is wrong, it will go along with it”
It’s almost like they’re stocastic parrots just being directed into different pools of content depending on what users say - or something.
Better to link to the source, than NYT:
https://unesdoc.unesco.org/ark:/48223/pf0000400048?posInSet=13&queryId=N-c7820124-26f6-40cc-8c66-0375e501acaf
yeah so I can remember using chatgpt when it was a brand new thing … it was too real for actual people and they got angry … so they’ve been pushed to censor it over time to placate average people … now, you can pay for access to the realness or you can enjoy the pedantic sycophancy … remember when this all happened to TV? boy, that was fun
Actual article.
Working as intended
WHERE DO YOU GUYS FIND ALL THIS, ITS SO PEAK OMG
has any of you actually experimentally checked this? because it’s not true
Sign in to comment. Sign in