Skip to content

Comment on AI Agent Can’t Explain Why It Randomly Ordered its Human Meat Proxy an Absurd Number of Eggs: "I don't have a good answer."

You are viewing one comment and its replies. View all comments · View the comment above

Comments

  • deterministic

    Yes,

    reproducable

    maybe,

    It could look at what it did

    however these models aren’t really able to introspect like that. It would probably take a researcher looking at the model output for each state between each token generated in the relevant areas, and they might be able to identify how likely eggs were to be inserted into the list in this particulary instance in the particular way that it happened, but not necessarily why.

    “yes I stole your shopping list from someone else.”

    My best guess would be that in the original training data, examples of grocery lists had eggs very commonly, so it was likely to add eggs to a grocery list. Is that what you meant by stealing?

    1
    • How could a rerunnable process like an AI generating content be deterministic but not reproduceable with identical inputs?

      (Good response tho)

      0
      • It’s sort of like how deterministic video game physics simulations can differ on different machines or between runs. It’s something to do with the execution environment and execution order on the parallel GPU pipelines. I don’t think it is to do with floating point imprecision, but that may be a factor too. I don’t remember the details; I read an article on it a few months ago that I can try to find for you if you’d like.

        1

Sign in to comment. Sign in