Twitter's badge of dishonor
The weekend's verification bonfire is an all-time case study in doing trust and safety wrong
Today let’s talk about Twitter’s darkly hilarious misadventure with verification badges over the weekend through two lenses: first tech policy, then business.
However messy they were, the basic events of the weekend are not in dispute. After months of saber rattling, on Thursday morning Twitter at last went ahead and did what it had long promised to do: remove the verification badges of everyone who is not subscribed to Twitter Blue.
As before, impersonators immediately swarmed the platform. Fake popes, RuPauls, and paramilitary groups all appeared and began to spread misinformation. Much of the mischief was essentially comedic — though some, as with that paramilitary group, was aimed at sowing chaos in a war zone.
At the same time, with the loss of those checkmarks on hundreds of thousands of previously verified politicians, government accounts, celebrities and journalists, discerning who might be responsible for any given tweet immediately became much trickier. Is that really Robert DeNiro — or just someone who swapped out the first “o” for a “0”? (It was the latter, and it fooled his friend Henry Winkler.)
In one fell swoop, a problematic but essential aspect of Twitter was vaporized in pursuit of subscription revenue. (About which more later.) Had that been all that happened this weekend, we would have more than enough to talk about. But then things got much more chaotic.
First, Elon Musk said that he personally paid the subscription fees for LeBron James, Stephen King, William Shatner, and other celebrities — in some cases, to their horror. Turning the old verification program into Musk’s personal Patreon had caused the badge to lose nearly all of its former cachet; many users began talking openly of blocking all newly verified users on sight. That led celebrities like King to protest that he had not, in fact, subscribed to Blue — to which Musk replied, memorably: “You’re welcome namaste 🙏.”
Click on King’s new, unwanted “verified” badge and you receive the following message: “This account is verified because they are subscribed to Twitter Blue and verified their phone number.” In the case of King and other unwanted badge recipients, neither was true.
In this way, on the first day of the new verification system, Musk managed to destroy it for a second time. The first when he completely changed the meaning of “verifying” an account without changing the visual design; the second came when, after giving verification that new meaning, he changed it again without telling anyone. Verification might now mean that you are paying for Blue; it might also mean that someone else is.
That was Thursday. By Sunday, verification had taken on yet another possible meaning: that no one was paying for the account at all. After formerly verified accounts shrugged en masse at the loss of their badges, an apparently panicked Twitter sought to restore some prestige to the program by restoring checkmarks to large accounts, including what appeared to be most with more than 1 million followers.
But even this was done with no apparent rhyme or reason. Here’s Low De Wei at Bloomberg:
Users were quick to speculate on whether the label was automatically provided to accounts that cleared a million subscribers. But there appeared to be key exceptions, with the profiles of stars like actor Ryan Reynolds still missing a blue tick he once held, despite having more than 21 million followers.
More bewilderment was in store after people noticed that dead personalities’ accounts also sported the label, such as celebrity chef Anthony Bourdain and National Basketball Association player Kobe Bryant. Bourdain died in 2018 and Bryant in 2020.
There was another, apparently punitive aspect to some users being awarded checkmarks once again. Company critics including Hasan Piker, Matt Binder, and Weird Twitter king @dril all received what the press immediately began to call “spite” badges, to the confusion of all.
And as if that wasn’t enough — in the midst of all this, and after weeks of trolling public media outlets like NPR by assigning them various labels intended to be derogatory, Twitter dropped them for both independent public media and state-funded propaganda outlets from China, Russia, and other countries. And so what could have served as an alternative verification system for some prominent journalists went up in smoke as well.
There was a time — call it “November” — when I found Musk’s thrashing with Twitter depressing. It was sad to watch a product that could be so entertaining and educational wither under his oppressive ignorance.
By now, though, it’s clear that Twitter is headed into bankruptcy. And with Musk determined not to learn any lessons from his first six months running the company, we’re getting an unexpected gift: a natural experiment in what would happen to a large social platform if you systematically blew up every trust and safety system it has.
Among conservatives, after all, it’s a truism that content moderation is too aggressive; that platforms would thrive by adopting a free-speech ethos; and that Silicon Valley liberals are out of touch with what most people actually want from their social networks.
The perma-flailing of alt-platforms like Parler, Truth Social, and Gab has offered ample evidence that this is not the case. But the failure of Twitter on such a grand scale that even its smugly anti-woke investors, led by Andreessen Horowitz, won’t be able to ignore it.
And on the flip side, all the trust and safety workers struggling to retain their jobs in this layoff-heavy year now have an excellent example of how their work supports and makes businesses possible.
So that’s the tech policy angle: Musk’s Twitter has become a historic case study in the relationship between tech policy and the health of a social network. For that, I’m sincerely grateful.
That leaves the business angle — and it’s worth saying just how bad for business all of this has been.
Since Musk took over, his friend David Sacks has been selling him on the idea that Twitter should become a subscription business. Musk has an aversion to ad-based businesses generally, and Sacks offered him an alternative: sell Twitter as enterprise software to individuals, sports teams, publishers, and other organizations that would see value in verifying their presence on the platform. Individuals get blue checks; organizations get gold ones.
It’s not at all clear that such a business would generate more than the $5 billion a year that the old Twitter used to make. But to even have a chance, the verified badge would have to retain enough of its value that organizations would conceivably pay for it.
The events of the past weekend likely ended those hopes for good. As with blue checks, gold checks have been granted to various non-paying organizations based on undisclosed criteria. Other organizations are applying for gold checks, being rejected, and complaining that Twitter won’t refund the $1,000 application fee. Twitter’s idea to boost the number of paying organizations is to require advertisers to subscribe to Blue in order to post ads on the platform, while giving a free gold check to anyone who spends $1,000 a month with the company.
Reading all this, it’s no wonder that Twitter ad revenue is down 50 percent since October. And it’s now clear individuals aren’t going to pay, either: NBC’s Ben Collins reported that on Thursday, Twitter Blue saw only 28 net new signups — twenty-eight.
It’s all going badly enough that even some employees who are sympathetic to Musk are blanching at the verification mess.
“Could have avoided all the chaos by just saying hey, everyone has access to verification now, all legacy verified gets 6 months free blue verification,” one employee wrote in Blind, the pseudonymous workplace forum. “Our goal is to provide same access to everyone. Instead we picked fights with our most valuable customers. Now Elon is deciding who gets free Blue. Full circle. There is a lot that Elon is right about, this is just not one of those.”
More on Twitter: My story on Yoel Roth’s time at Twitter, both before and after Musk took over, aired this weekend on This American Life and can now be found on your podcast player of choice. It was produced by the great Davis Land and David Kestenbaum; I’m so grateful to them and everyone at This American Life for helping me talk about trust and safety with a whole new audience.
Talk about this edition with us in Discord: This link will get you in for the next week.
Governing
Support for banning TikTok in the U.S. correlates with partisan political affiliation, with a majority of Republicans but only one-third of Democrats supporting a ban. More than half of those polled who want TikTok banned say they have never used it. (John D. McKinnon / WSJ)
TikTok’s U.S. data center operations in Virginia have been plagued by security issues, and also show clear signs of involvement with companies partially owned or controlled by the Chinese government. (Emily Baker-White / Forbes)
The Department of Homeland Security announced a new task force that will be responsible for using AI to better protect the U.S. and defend against malicious use. (Lauren Feiner / CNBC)
A new poll of American workers finds that a vast majority are wary of AI being used to make final decisions on hiring, firing and evaluating workers. (Pew Research Center)
The U.S. Supreme Court agreed to take on two separate appeals on whether public officials should be allowed to block critics on social media. (John Kruzel / Reuters)
President Biden plans to sign an executive order that will reduce American investment in high-tech areas of the Chinese economy like semiconductors, AI, and quantum computing. (Jenny Leonard / Bloomberg)
The U.K. government proposed a new bill to place digital markets under the purview of its Competition and Markets Authority regulator. (Kate Beioley and Jim Pickard / Financial Times)
Microsoft plans to unbundle its Teams app from its Office software suite as part of a potential agreement to avoid regulatory action in the EU. (Javier Espinoza / Financial Times)
Apple won an appeals court ruling in its antitrust battle with Epic Games, affirming a lower-court opinion that its App Store policies do not violate antitrust law. Thanks to regulatory pressure in the EU and elsewhere, though, Apple has already begun (barely) loosening some developer restrictions. (Malathi Nayak / Bloomberg)
A profile of cybersecurity expert and Granitt founder Runa Sandvik, who specializes in protecting journalists from state-sponsored hacks, highlights the current threats to press freedom posed by authoritarian regimes. (Maddy Crowell / Columbia Journalism Review)
Tesla won a California lawsuit alleging its Autopilot system was to blame when a woman’s Model S crashed into a curb and caused personal injury. The company claimed the driver was at fault for using Autopilot on a city street. (Abhirup Roy, Dan Levine and Hyunjoo Jin / Reuters)
Online disinformation detective Shawn Eib of cybersecurity startup Alethea is part of a growing industry dedicated to combatting online disinformation campaigns designed to destabilize industries like banking. (Margi Murphy / Bloomberg)
Industry
The viral, synthetic Drake and Weeknd song was pulled from streaming services and YouTube on copyright grounds, but there’s no legal precedent to determine whether creations like this are unauthorized “derivative works.” This could create a legal morass for Google, which is both developing generative AI tools and trying to operate a copyright-compliant music and video platform. (Nilay Patel / The Verge)
Grimes told fans to go ahead and use her voice for AI-created music, saying she’ll split royalties 50-50 with creators. Super interested to see which artists choose this path, and which choose the other. (Martine Paris / Forbes)
The world of freelance copywriting has been upended by the launch of ChaptGPT, which is contributing to growing mistrust and tension between hiring firms and writers who typically transact on platforms like Upwork. (Rashi Shrivastava / Forbes)
The largest free dataset for text-to-image AI generators, called LAION, was co-created by a high school teacher who found likeminded collaborators on Discord. (Marissa Newman and Aggi Cantrill / Bloomberg)
Snapchat’s new My AI chatbot is proving controversial, with some users demanding it be removed from their feeds and criticizing Snap for not making it an opt-in feature. Did not see a torrent of one-star reviews for the app coming, but seems like the criticism is more about an unwelcome change to the UI than anything else. (Sarah Perez / TechCrunch)
Pioneering computer scientist Jaron Lanier argues against the term “artificial intelligence” in new essay, saying it mythologizes the technology in a way that may make it more difficult to develop it safely. (Jaron Lanier / The New Yorker)
The Markup CEO Nabiha Syed interviews former federal judge Katherine Forrest on the seismic shift generative AI is forcing onto existing copyright law. (Nabiha Syed / The Markup)
Google’s planned 80-acre campus in San Jose, now a demolition site, has been put on hold after the company began reducing its office footprint this year as part of ongoing cost-cutting efforts. (Jennifer Elias / CNBC)
Google fixed a security flaw present in its cloud platform named GhostToken that allowed hijackers to hide malicious apps on someone’s account. (Sergiu Gatlan / BleepingComputer)
Apple’s new mixed reality headset doesn’t yet have a killer app, and instead the company is hoping its kitchen-sink approach will resonate with early adopters while it develops additional features. (Mark Gurman / Bloomberg)
Apple is planning to increase its investments in the financial services space following the success of its Apple Card, raising concern among banks and other industry players. (Patrick McGee and Joshua Franklin / Financial Times)
Secretive hardware startup Humane demoed its wearable AI assistant during a TED talk last week, and videos of the presentation have begun leaking online. (Jon Porter / The Verge)
A California judge sided with Bored Ape Yacht Club parent company Yuga Labs in a trademark infringement lawsuit the company brought against NFT rivals Ryder Ripps and Jeremy Cahen. NFTs are in fact protected under trademark law. (Sam Reynolds / Coindesk)
WhatsApp announced a new feature to let users save disappearing messages but only in the event the sender consents. (Richard Lawler / The Verge)
Those good tweets
For more good tweets every day, follow Casey’s Instagram stories
(Link)
(Link)
(Link)
Talk to us
Send us tips, comments, questions, and suggested This American Life pitches: casey@platformer.news and zoe@platformer.news.
"a natural experiment in what would happen to a large social platform if you systematically blew up every trust and safety system it has"
That's exactly what it is and I'm enjoying each and every second of it. There's no way he can talk his way out of it.
It clearly shows that Tesla and SpaceX are somewhat successful despite Musk. But at Twitter no one tries to control him and anyone can see that the emperor has no clothes.
As someone who works in T&S (not at Twitter) and is worried about the layoffs, this post meant a lot!