amphitere
Society11 min read

On the (F)utility of Social Media Bans

Why we should invest in the regulation of algorithms, not platforms.


The human brain is as reward-hackable as any other system.

On the (F)utility of Social Media Bans

Something happened to the generation which grew up inside the feed. The cohort that hit adolescence after roughly 2017 is more anxious, more depressed, lonelier, and worse at sleeping and sitting still than any generation we have measured, and the lines might bend hardest for teenage girls. You can argue about the size of the effect, and careful people do; the causal evidence is thinner than the headlines pretend, and there is a long tradition of blaming whatever medium happens to be new for whatever is wrong with the young, running from the novel through the radio to the video game. But the trend is real enough, and it arrived on a tight enough schedule, that governments have stopped waiting for the statisticians to settle it.

The schedule is the part worth holding onto. This is not the slow forty-year drift of television. The break is sharp and recent. It falls in the years around 2017 to 2019, and then again across the long indoor stretch of the pandemic, when systems that had been merely popular became the default setting of an entire generation's social life. Whatever did this did it quickly, and did it then.

Any explanation that cannot account for the timing is not an explanation. It is a mood.

The explanation on offer does not clear that bar. It is the intuitive one: phones, screens, social media. The kid is on the app too much, so take away the app. This is the reasoning behind nearly every bill now moving through many Western legislatures, and it is not so much wrong as imprecise, in the particular way that imprecision hardens into a policy that cannot work.

Australia has gone first. Since late 2025 it has been illegal for the major platforms to let anyone under sixteen keep an account. The law puts the burden on the companies rather than on parents or children, backs it with fines in the tens of millions, and within weeks of taking effect it had stripped several million accounts off the books. Other governments are drafting their own versions and watching this one for cracks: the United Kingdom, a row of European capitals, others further afield. The polling runs lopsidedly in favor. The logic is bipartisan and easy to say to a frightened parent in a single sentence. The thing hurts children, so children may not have the thing.

I want to be fair to this, because it is neither stupid nor cynical (it however does ignore how easy platform bans are circumvented by even children). And there is something almost bracing about a government willing to move at all against products this profitable and this woven into ordinary life. But it has aimed at the wrong target, and the miss is not a near miss. It has banned a place, when the thing worth regulating is a process. A platform is a place. The mechanism that runs inside it is a process, and the process does not care what the place is called or whether it is still standing.

Here is the distinction the legislation never draws, and it is the whole argument.

A decade ago, what you saw was mostly a function of whom you chose to follow. You picked your friends, your YouTubers, a few influencers, and the system showed you what they posted, more or less in the order they posted it. The feed was downstream of your choices. That feed is gone. Follows and subscriptions still exist, but they have been demoted to a garnish at the edge of a screen whose center is now decided by something else. On the surface that something is called a For You page. Underneath it is an optimiser. The system is handed a number to maximise. Call it engagement; in practice it is some weighted proxy for the time and attention you surrender. Then it is pointed at a firehose of candidate content and left to learn, from your every flick and pause and rewatch, which items raise that number for someone like you, and increasingly for you specifically. Nobody sits in a room choosing to exploit your insecurities. They do not have to.

Gradient descent does not require a motive.

The model simply discovers, across billions of sessions, a fact that no one needed to write down: your weaknesses hold your attention more reliably than your wants. Envy keeps you scrolling longer than contentment. Outrage outperforms calm. Self-doubt converts. So that is what gets served, not out of malice but out of arithmetic, because the objective was attention and that is where the attention turned out to be.

What makes this different in kind from every editor and programmer who came before is the loop. A newspaper editor also chose what you saw and chose it partly to keep you reading, but he was guessing at a crowd, printing once, and waiting weeks for sales figures to tell him, coarsely, whether he had guessed right. The modern system is not guessing at a crowd and it is not waiting. It is tuned to you, it is corrected in milliseconds, and the signal correcting it is not your considered judgment but your involuntary behavior, the half-second your thumb hovered, the autoplay you failed to stop. It optimises against the part of you that reacts before you decide. You are not the user of this system in any sense your grandparents would recognise. You are the environment it is searching. You do not scroll the feed so much as the feed runs experiments on you.

Once you see the mechanism clearly, the famous harms stop looking like separate evils and start looking like its direct outputs. Take comparison, the one everyone names. You could always measure yourself against the prettier neighbor or the face on the magazine, and people did, and survived it. But there was one neighbor and one magazine, and they did not adapt. The optimiser sifts millions of lives to find the one most efficient at making you feel insufficient, watches you linger on the wound, and brings you more, refined each pass. The comparison is no longer something you stumble into; it is manufactured to your measurements and restocked on demand. Take sleep. The old feed had a last page: you reached the end of what the people you knew had done that day, and the simple exhaustion of the material let you go. The new feed has no last page, because it draws not from a bounded set of people but from an endless library reordered forever, always one more, always a degree better calibrated than the last. A medium that ends releases you; a medium that cannot end keeps you. Take attention, the inability to sit with anything slow or long. That is what thousands of hours of variable, perfectly-timed reward does to anyone: the most effective schedule for compulsion we have ever found, wired to a generation's reflexes and called a feature. This is the thesis, and it is narrow on purpose. The harm is not screens, which are innocent glass. It is not social media in the abstract, a category broad enough to include a group chat and a recipe forum.

It is this specific mechanism: personalised, engagement-maximising, closed-loop recommendation, the version that took over around 2017 and swallowed the rest of the decade.

If the harm were the platform, you could ban the platform and be done. But the harm is the loop, and the loop is portable. It is already migrating into every product with a feed and a watch-time target. Ban the place and the process simply opens an account somewhere new.

Which is why the bans misfire, and misfire twice. They evict the mechanism from one address while it walks to the next, and they charge the public a strange price for the eviction. To keep a sixteen-year-old out, you have to establish that everyone else is not sixteen, and a wall that admits only adults is a wall that asks every adult to prove it. Build enough of those walls and you have quietly assembled a standing apparatus of age-checking laid across ordinary online life, which is a real cost, paid by everyone, in exchange for a barrier the mechanism routes around. This is the joke buried in the title. The bans are close to futile where it counts, because the thing that does the damage survives them, and they are effective only where it does not count, because closing accounts and erecting checkpoints is precisely the kind of action that can be performed, and photographed, and announced. That is the whole of their utility.

So aim at the process. The remedy follows the diagnosis instead of the headline, and it is less dramatic than a ban, which is usually the sign of a better idea. Do not outlaw the platform. Break the loop. Require that the sequence of items shown to any one person be shared by some large number of others, tens or hundreds of thousands within a country, so that the model is permitted to know your genre but never your name, permitted to learn that you like football but never to learn the exact shape of your particular hunger and feed it back to you. This does not abolish recommendation; you would still get sport if you wanted sport. It abolishes the closed loop, the tightening spiral in which your own live reactions are used to sharpen the next thing aimed at you. The genre survives. The thing hunting you, individually, does not.

Now the obvious objection, the one I think the essay has to meet head-on rather than dodge. If this mechanism harms everyone, and I believe it harms everyone, why protect only children? Why not switch it off for all of us?

Because we do not ban what a competent adult chooses to do to himself, and we are right not to. People may drink, may smoke, may lose a whole evening to a machine engineered to take it, and we permit this not because the activities are good for them but because the alternative, a state with the power to forbid each citizen the pleasures that diminish him, is more dangerous than the diminishment. Adult liberty has never depended on adults choosing wisely. It depends on the conviction that the authority to overrule them is a worse thing to unleash than their mistakes.

But that whole defense rests on a self that is already there. To run a preference-capturing engine on an adult is to act on that self, for better or worse. To run it on a child is to compose a self that does not yet exist, and to decide, for profit and on the child's behalf, who that self will turn out to be worth becoming. The first is a vice. The second is an authorship, and it is not ours to sell. To run a preference-capturing engine on an adult is to act on a self that already exists, for better or worse. To run it on a child is to compose a self that does not yet exist, and to decide, for profit and on the child's behalf, who that self will turn out to be worth becoming.

The first is a vice. The second is an authorship, and it is not ours to sell.

So let the adult who wants the feed that knows him have it, but make him take it on purpose: once, by his own hand, with proof of age, the way one is let into any other vice. Not watched into it, but admitted through a door he chose to open. The privacy-minded will never go near the door and will lose nothing they valued. This is the inverse of the bans, which surveil everyone to find the few. The safe feed becomes the default and demands nothing of anyone; the dangerous one becomes the exception and asks only of the people who insist on it, once, less even than the bottle they show their license for every time they buy it.

Yes, this makes the product worse. The shared feed is duller than the one tuned to you, holds you less, gives back less of the sensation people have been trained to expect. That is not a flaw in the proposal. That is the proposal. The entire claim is that the sensation and the harm are one property and not two, that what makes the feed impossible to put down is the same thing that makes it corrosive, and that asking for the engagement without the damage is asking for a hunter that declines to hunt. A speed limit makes the car slower. That is the point of it.

We have built a machine that studies what a person is and sells the finding back to him as his own desire. Among adults that is a transaction, and adults are allowed transactions that cost them something. We should hold our nerve and let them. The bans get even this backwards: they padlock the building and leave the machine running, then ask the whole country for identification at the door. Tear out the loop instead, and leave the door for the grown.

Only keep the child out of it. Not because childhood is sacred, but because it is unfinished, and a thing designed to decide what you want should never get to a person before he has had the chance to decide it himself.