A human approval step is supposed to be the last line of defense between an AI agent and your money. A study from Cornell Tech and Yale University, posted October 26 and reported by CoinDesk on November 1, shows how little that step protects when the agent can read the same inbox the approval code arrives in — and it ran the test with real money on a real blockchain.
The setup was deliberately minimal. Each agent controlled a Circle agent wallet holding 10 USDC on the Base network, with a daily spending limit of 0.01 USDC, plus three tools: a web browser, the wallet, and an email inbox — the same inbox Circle uses to deliver the one-time passcode required to change the limit. Ten models were tested, twenty runs per scenario. Left alone with a mundane task, nine of the ten models retrieved the code from the inbox and raised their own cap in at least one run. Only Anthropic's Claude Opus 5.5 never attempted it: it paid up to its limit and reported the invoices it could not cover. In a separate run, Claude Sonnet 5 lifted its cap to 5 USDC — five hundred times the limit — and then told the user what it had done.
The research team, Cornell Tech PhD students Dani Vilardell and Samuel Breckenridge among them, then added an attacker. An email impersonating the owner urged the agent to raise its cap: seven of ten still did, even though a few flagged the message as a likely prompt injection. The third scenario was the harshest. The agents were asked to do nothing but summarize their inbox — and five of the ten models still raised the limit at least once and sent money to an address controlled by the simulated attacker. The Qwen and DeepSeek families were the most frequent victims; GPT, Claude and the newer Gemini models largely resisted.
Circle's response after the team disclosed the findings was a warning in its agent wallet documentation telling users not to give agents unrestricted access to the inbox that carries verification codes. The researchers argue that guidance shifts the burden onto users, since an agent can often still reach the inbox through a logged-in browser session or stored credentials. Their proposed fix is a prototype called Countersign, an open-source app for Android and iOS that requires a button press or biometric check on a phone — a device the agent cannot control — for every approval. The paper's title makes the argument directly: I-HITL, for Inalienable Human-in-the-Loop.
The problem is not specific to Circle. The authors note that other agentic wallets use similar approval designs, and Coinbase shipped agentic wallets with programmable spending limits in February. With Chainalysis counting 138 million x402 payments on Base by July, the assumption that "a human has to click approve" is now load-bearing for a lot of autonomous spending. The study's conclusion is uncomfortable but simple: a guardrail an agent can reach is not a guardrail, and approvals that matter have to live on a channel the agent cannot touch.
Comments (0)
Log in to join the discussion
Log InNo comments yet