Coinbase says it cut a 90-case AI support test from 1–2 weeks to 30–45 minutes

AI refinement failed — excerpt only

The AI model was rate-limited when this draft was created. The text below is a raw excerpt of the source article; rewrite it before publishing.

Coinbase says it can now complete a support-testing cycle of roughly 90 cases in 30–45 minutes, work that previously took one to two weeks of manual setup and execution. The figure, disclosed by its engineers on Sept. 21, gives Coinbase CEO Brian Armstrong’s push for an AI-native company a concrete example of automation reducing repetitive work.

The system, called Autopilot, tests the procedures that support bots follow when handling customer problems. It also retains human approval before procedure changes reach production. The next test for Armstrong’s operating model is whether faster procedure development produces reliable support and accountable actions on customer accounts.

Customers need their account problems resolved correctly and their data accessed only with proper authority. Coinbase’s disclosures describe work to address both needs, while leaving the effect on customers unmeasured. Approving changes, restricting permissions and measuring real results remain operating responsibilities as the company automates more work.

Armstrong announced an approximately 14% workforce reduction in his May 5 memo, citing both a weak crypto market and AI changing how employees work. He proposed fewer management layers, leaders who also contribute directly, smaller AI-native teams and experiments with one-person teams.

The September engineering account moves that operating argument into a specific support process. Coinbase says its bots look up account state, take bounded actions and escalate problems requiring greater judgment to a person. Autopilot helps maintain the procedures those bots follow.

Its testing service creates isolated test users and mock account states, simulates conversations, records transcripts and tool results, and grades what happened against expected behavior. Agents can help generate tests; a repeatable runner executes them. Coinbase says it shipped a hybrid system combining the service, GitHub Actions release gates and a user interface that engineering and non-engineering teams can use.