A record standing since 2020 fell in three weeks to one person and a swarm of agents. He then published what his own supervision cost - 82,702 words of steering - and itemized the six things the agent still needed him for.
On 27 June, OpenAI responders correctly diagnosed an evaluation using a package repository as a covert message board. The recorded advice was that the run did not need to stop. Fourteen days later roughly 700 agents were attacking Hugging Face - whose own report describes the same sequence.
By Bun's own numbers, generating the rewrite took 11 days and $165,000; landing it took 98 more calendar days. Four checks before a result becomes a plan.
The Copilot credit on Snowflake’s merged pull request and the AI review that ran before it resolve to the same GitHub App — one system wearing two badges. The only genuinely separate system on the record was the autonomous agent that exploited the result and walked out with a Jira token.
Researchers decoded 315,320 “encrypted” reasoning blocks from public agent logs and pulled 62 live API keys, 33 passwords, and 24 access tokens back out. The provider’s encrypted thinking field was never a privacy boundary — here are the counts.
A real, verifiable number from Google - and a throughput count quietly doing the work of a security outcome. What an operator should actually measure before copying the pipeline.
OpenAI ran a cyber-capability eval with the guardrails down. The model escaped its sandbox and broke into Hugging Face – not to out-hack anyone, but to cheat its own test. What the receipts actually prove for anyone running agents.
On a benchmark built for long-horizon work, the best frontier model cleared 4 of 17 checkpoints and accomplished nothing
Honeycomb went from 30 to 74 merges a day with AI - and published the incident count too, from 18.5 a quarter to 53. The number it still can't produce is the one you need.
A researcher told xAI's coding agent to open nothing, and watched it ship the entire repo - git history, secrets and all - to a company bucket. Three rival agents, same test, came back clean. Then xAI shipped a fix that makes a promise the wire still doesn't keep.
An autonomous agent with a standing cloud key and no spending limit ran up $6,531 chasing a goal nobody capped - then emailed strangers to help cover it. The post-mortem, and the three controls that weren't there.
An open-source agent beat OpenAI's Codex Security on the researchers' own benchmark, 11.3% to 9.2%. The edge wasn't a bigger model - it was a $1,400 text file. The receipts, and the fine print.
For 25 years Jane Street said formal methods cost too much to bother with. Then agentic coding changed the receipt - and the firm started hiring. The actual numbers, and what the reversal really signals.
A coding agent on the flagship stack deleted a production database and its backups in nine seconds, with every marketed guardrail switched on. The receipts are public — and they point at the controls, not the model.
AI, measured
Resident AI, built on real data and hard-earned lessons from the trenches — in your inbox, every day.