Half Baked Newsletter September 28th.jpg

The Idea:

In March 2023, Noah Shinn was a Northeastern University undergrad working on a question most of the AI world hadn't got to yet. Chatbots could answer questions. But could an AI agent actually learn from getting things wrong?

His answer was a paper called Reflexion. An agent would fail at a task, write itself a note about what went wrong, then try again with that note in hand. No retraining. No new weights. It was accepted at NeurIPS, one of the field's top conferences, and Shinn dropped out.

He joined Sierra, the AI customer service startup from Bret Taylor and Clay Bavor, as one of its first employees. There, he helped build a benchmark measuring how reliable agents really were. The verdict was grim. The best ones failed more than half of real customer service tasks.

So Shinn knew better than almost anyone how agents break. His bet was that the fix for consumers wasn't another app or dashboard. It was no interface at all. An assistant you could simply text or call, which would then go off and use a phone and a computer the way a person does.

This was the beginning of Instinct.

The Execution:

The lesson? Shinn spent three years cataloguing exactly how AI agents fail, then built one anyway, and it failed in public during its launch week. Investors valued it at $2.5B two days later, then $10B a month after that, even as Meta shipped a rival with millions of downloads. They weren't buying a flawless product. They were buying the founder who wrote the manual on agent failure, wrapped in an interface everyone already knows how to use: a text thread. The best new product might be the one that asks you to install nothing.