Growing AI Scandal With Careers At Stake

Over the past month, A.I. detection has been at the center of a series of controversies: Hachette pulled the horror novel "Shy Girl" by Mia Ballard after detectors flagged it as substantially A.I.-generated.

The New York Times cut ties with a freelance book critic who admitted that an A.I. editing tool had regurgitated passages from a Guardian article into his draft. The Atlantic reported that a "Modern Love" column had been flagged as more than 60 percent A.I.-generated.

In certain corners of social media, A.I.-detector screenshots are shared like mug shots, and pile-ons have the grim energy of public stonings.

This may all seem understandable—people want to know if what they’re reading was generated by a bot, and some argue they deserve to know. However, such controversy narrows the issue of A.I.’s steady encroachment to one of process, rather than impact.

Drawing a red line around using chatbots to generate prose may make it easier to ignore the way that the technology may be shaping writing before one even types a single word. And a culture of callouts, scandals, and fear may prevent media and publishing from wrestling with much thornier questions of authorship.

At the center of many of these controversies is a company called Pangram, whose CEO, Max Spero, has become the go-to authority when A.I. authorship disputes erupt. On Twitter/X, where Spero calls himself a "slop janitor," a user flagged a Guardian sports journalist’s writing as A.I.-generated. The publication responded that this was "the same style he’s used for 11 years writing for the Guardian, long before LLMs existed. The allegation is preposterous."

Spero quote-tweeted the exchange with a Pangram time-series analysis of 871 articles by the journalist: "It’s clear that he is increasingly relying on AI. In two weeks in February he churned out nine articles classified by Pangram as fully AI-generated. Receipts below."

Or take Pangram’s appearance in the Shy Girl cancellation. Readers on Reddit and YouTube had been flagging the horror novel as suspiciously A.I. for months, but then Spero ran the full manuscript and posted the result (78 percent A.I.-generated). Hachette pulled the book the day the Times piece ran. A story in the Atlantic soon followed. Spero was on LinkedIn, urging publishers to "strictly moderat[e] AI generated content" and "draft and enforce robust AI-use policy."

A pattern emerges: The crowd suspects a problem, then Pangram validates the suspicion, stokes the mob, and sells the solution. The impulse to dismiss all this as a detector company drumming up business runs into an issue—Pangram actually works way better than you might think. Brian Jabarian, a University of Chicago economist who conducted a rigorous independent evaluation of A.I. detectors, told me flatly, "This narrative that we shouldn’t use A.I. detection doesn’t seem to hold anymore."

Jabarian’s preprint, co-authored with Alex Imas and with no disclosed financial ties to the company, tested the tool across nearly 2,000 passages and found near-zero false-positive and false-negative rates on medium-to-long texts, the length of a typical op-ed or a verbose Amazon review.

Independent benchmarks confirm that Pangram outperforms every other detector tested and is robust against "humanizers," or software designed to smuggle A.I. text past detectors. So when Spero posts a time-series chart of hundreds of articles showing when a journalist’s output started sounding fishily like ChatGPT, I am inclined to believe it. That A.I. detection is finally catching up is, on balance, a Good Thing. A.I.-generated articles already far outnumber human ones. Social media is flooded with low-effort slop. According to Pangram’s own research, a fifth of peer reviews submitted to the A.I. research conference ICLR are fully A.I.-generated, and 9 percent of American newspapers contain undisclosed bot use. In this A.I.-powered asphyxiation of the information ecosystem, Spero has positioned himself on social media as a folk hero hauling in the oxygen tanks. You can tag his company’s bot on Twitter/X, and it will tell you whether a post is A.I. On Spero’s social media to-do list: a "slop hunter of the week leaderboard."