Half Baked Newsletter September 23rd.jpg

The Idea:

In the mid-2010s, Alex Ratner was a computer science PhD student at Stanford, working under Chris Ré, a professor who had already sold an earlier AI company, Lattice Data, to Apple. The pair noticed that even Google and Microsoft were struggling with the mountains of hand-labelled training data their models needed. Doctors were being asked to tag X-rays one at a time. Ratner thought making experts label 10,000 data points by hand was a ridiculous waste of what they knew.

Their fix was simple. Get experts to write down their rules of thumb, then let software apply them at scale. In a trial with Stanford Hospital, labelling that had taken person-years was done in hours. The Snorkel research project launched at the Stanford AI Lab in 2015. After four years deploying it with Google, Intel, Apple and DARPA, Ratner, Ré and fellow researchers Paroma Varma, Braden Hancock and Henry Ehrenberg spun it out. The pitch was blunt: replace the armies of human labellers.

This was the beginning of Snorkel AI.

The Execution:

The lesson?

Snorkel spent six years building software to take humans out of data labelling. The breakout came when it put the experts back in and charged for the finished product, not the hours. The thesis that AI is a data problem never changed. The business model did, and it cost 31 jobs and four flat years to find the right one. Hold your thesis tightly and your product loosely.