It’s still consistent with my experience, but in certain contexts, can be corrected if the output can be processed in some context that can auto detect wrong output. For example if you have a unit test to pass, then it can be wrong several times but doesn’t matter because it auto runs and gets directed to try again.
In contexts without the possibility to objectively measure correctness, it is still pretty bad.
Yeah, if you pay, you’re right. But how often would you say the newer models are incorrect? Even if it’s 1%, that still hold true that you can’t check them.
Id say its accurate more than 90% of the time. I see erroneous facts added to the response that are wrong or not correctly represented the most.
Do you apply this same logic to the “experts” that you talk to? I talk with alot of SMEs from different domains. I could never fact check them all. Way too broad of subject matters. Similar to many of my indepth AI interactions
Comments
Im not an AI lover, but this critique that it is wrong 50% of the time is simply not true for newer models.
It’s still consistent with my experience, but in certain contexts, can be corrected if the output can be processed in some context that can auto detect wrong output. For example if you have a unit test to pass, then it can be wrong several times but doesn’t matter because it auto runs and gets directed to try again.
In contexts without the possibility to objectively measure correctness, it is still pretty bad.
Id say its better than majority of my colleagues. Can you imagine if we fact check people in the same way?
Yeah, if you pay, you’re right. But how often would you say the newer models are incorrect? Even if it’s 1%, that still hold true that you can’t check them.
Id say its accurate more than 90% of the time. I see erroneous facts added to the response that are wrong or not correctly represented the most.
Do you apply this same logic to the “experts” that you talk to? I talk with alot of SMEs from different domains. I could never fact check them all. Way too broad of subject matters. Similar to many of my indepth AI interactions
Sign in to comment. Sign in