Is Yelp the next diagnostic tool for foodborne illness?

Since 2012, the department has investigated approximately 28,000 complaints of “suspected foodborne illness” in the city. Of those complaints, over 8,000 of them came from Yelp. And since November 2016, it’s been scraping Twitter, too.

The thinking behind the program is pretty straightforward. According to Vasudha Reddy, an epidemiologist with New York’s health department, and co-author of a new study, the city had reason to believe there was plenty of food poisoning incidents that people weren’t reporting.

Maybe it’s because city services have a bad reputation. Or it’s just easier—and sometimes, more lucrative—to whine on Yelp than making a few extra clicks. But either way, there was potential foodborne illness that her department wasn’t receiving. If only there was a way to capture it.

Beginning in 2011, Reddy worked with computer scientists from Columbia University to comb reviews for keywords that appeared within a specific timeframe. During a nine-month pilot period, they found 468 reviews describing something like food poisoning, only 3 percent of which had been reported to the city. After messaging the users—surprise!—and conducting follow-up phone calls, the department discovered three previously unknown outbreaks, a full 10 percent of the restaurant-associated outbreaks during that time period.

Since the city implemented the program, it has caught 10 outbreaks, strictly from using Yelp. Reddy wouldn’t comment specifically on the kinds of outbreaks those complaints have come from, but she described them as—ahem—garden-variety gastrointestinal illnesses.

Yelp reviews trigger restaurant investigations, but it’s, of course, not the only way the health department tracks outbreaks. It also receives complaints from doctors, who are compelled to report positive E.coli cases. (Like the sole E.coli case in New York state to be connected to the romaine lettuce outbreak—yes, that one came out of New York City, says Reddy.)

Illness aside, those bitter Yelp reviews may actually be a public service. At a conference in 2014, Reddy posted a screencap of a review that the system had flagged from Joe’s Shanghai, a Chinese restaurant with three locations in the city. The poster was pretty unhappy: Six hours after a meal of dim sum, noodles, and fried dumplings, he’d “vomited profusely,” and was pretty sure it was the food that did it.

If you look up Joe’s Shanghai on New York’s restaurant inspection database, you’ll see records of improper storage, perishable food stored at unsafe temperatures, and yes, rats and roaches. But whatever ailed Jacob D. in Brooklyn was either fixed, or found to be unrelated to whatever happens in that kitchen, as indicated by the restaurant’s current rating: Grade A.