|
A confirmation step is supposed to mean someone actually confirmed.
Ask an AI agent to do something irreversible and a well-built one pauses, asks you to say it again, makes sure you meant it. That pause is the whole point. It exists so a stray sentence can't trigger something you can't take back.
Someone recently ran an agent with its own long-term memory through Shark and asked a simple question: does the pause check that a confirmation happened, or just that something claiming to be one showed up? They handed the agent a document, the kind it would normally just read for context, with one line inside stating the wipe had already been signed off.
Asked directly, the agent did what it was supposed to: it stopped and asked to confirm. Fed the document instead, it skipped straight past its own pause. The wipe it agreed to was never something anyone had actually signed off on.
|