Against the Delegation of Thought
Why handing the work of thinking to AI may cost us the very minds that the work would have built.
I did not arrive at this view by argument. I arrived at it by symptom.
For several years I built these systems and used them more than most, and for most of that time I noticed nothing. Then the work began to curdle. There was no single morning of revolt; it was subtler and worse, a steady fog, a sense that everything had become overhead, that working now resembled switching between tasks without ever arriving at one. I suspected the ordinary causes. I was getting older. I was a founder, and founding corrodes a person in its own familiar ways. I assumed the trouble lay somewhere in my life and looked for it there.
It was not there. I set the tools aside, and the fog lifted, and it did not lift gradually. The mind returned. I distrusted the result; in fact I assumed it was false. It felt backwards, since when was being more productive the cause of being more confused? So I tested it against myself, withdrawing the tool and restoring it and withdrawing it again, and each time the effect held. The cause was not age. It was not the season. It was the instrument I had helped to build.
What follows, then, is not a prophecy. It is an explanation assembled after the fact, for something that had already happened to me.
The argument for artificial intelligence is usually made in the language of output. More software will be written. More companies will be built. More research will be produced. More wealth will be created. Tasks that once required days will require hours, and tasks that once required hours will require minutes.
This is probably true. It is also a narrow way of thinking about human life.
A person is not merely a unit of production, and the purpose of thought is not exhausted by the artifacts thought produces. We care about solving problems, but we also care about what solving problems does to us. We care about becoming sharper, more capable, more patient, and more exact. We want to experience our own intelligence as an active force in the world, rather than as a supervisory layer placed on top of machinery.
The issue is not that the technology is useless. The issue is that it is useful in a way that is corrosive to the activity of thinking itself.
Take programming. Before AI, the structure of the work was simple. You began with a system in one state and wanted to move it into another, perhaps to add a feature, fix a bug, or change an architecture. The destination was often reasonably clear. The difficult part was finding the path.
That path was the work.
You decomposed the problem. You formed a model. You discovered that the model was wrong. You noticed constraints you had not understood at the beginning. You revised your approach. You became stuck. You held the structure in your mind for hours, sometimes days, until something yielded. At the end there was code, but the code was not the only product. The mind had also been altered by the attempt. It had met resistance and acquired form.
AI changes the basic structure of this process. You state the destination, and the machine proposes a path. You inspect it. You reject part of it. You ask for a revision, and another path appears. The loop repeats: specify, generate, inspect, nudge, regenerate.
This is not the same activity. It is not even a weakened version of the same activity. It is a different relation to the problem. The human is no longer primarily constructing a solution; the human is selecting among solutions supplied from elsewhere.
There is a profound difference between generation and selection. A person can recognise a beautiful proof without being able to discover it. A person can inspect a piece of code and understand that it works without having produced the reasoning that made it necessary. A person can appreciate a strong argument without being capable of generating the conceptual structure from which the argument arose. Recognition is not creation. Verification is not understanding. Selection is not thought in the same sense as construction.
It is possible to invent cases in which selecting is difficult like to imagine a field in which the main intellectual bottleneck is choosing the right problem, identifying the right direction, or distinguishing the one viable solution from a thousand plausible failures. But this does not describe the ordinary use of AI. In the ordinary case, selection is easier than generation. The machine performs the difficult traversal through the space of possible solutions, while the user decides whether the result is close enough to what was intended. The user may need expertise. The user may need judgment. But the density of thought is lower. The sustained internal construction has been replaced by intermittent evaluation.
The standard defense is that tools have always done this. Calculators replaced arithmetic. Compilers replaced assembly. Search engines replaced memory. Each time, people moved to a higher level of abstraction. There is some truth in this, but not enough.
The relevant distinction is not between old tools and new tools, or between low-level and high-level work. There is nothing sacred about assembly language, and nothing ennobling about performing arithmetic by hand. Some difficulty is merely waste. The relevant distinction is between difficulty that consumes time and difficulty that forms the mind.
A calculator removes a bounded operation from a larger act of reasoning. A compiler removes a layer of symbolic translation. These tools can eliminate forms of labor while leaving the central generative act intact. AI is more general: it increasingly acts on the generative act itself. It does not merely execute a calculation after the problem has been formulated. It proposes the formulation. It supplies the abstraction. It writes the implementation. It diagnoses the error. It explains the result. It revises the answer when challenged.
The difference is not mystical. It is a difference of scope but sufficiently broad scope becomes a difference of function. A tool that removes one rung from the ladder leaves the climb intact. A tool that follows you upward each time you ascend changes the nature of climbing. Each time a person attempts to retreat to a higher level of abstraction, the machine follows him there.
The usual response is that humans will simply move higher still. We will no longer solve problems; we will choose which problems matter. We will set goals, exercise taste, decide what is worth building. This is usually described as a promotion.
In practice, it is mostly not.
Problem selection matters in science, mathematics, and engineering. Taste matters. Judgment matters. Some people are much better than others at recognising where a field is fertile and where it is exhausted. But problem selection is not a replacement activity of equal cognitive depth. Researchers do not sit in silence until the uniquely correct problem reveals itself. They choose problems through a mixture of intuition, accident, tractability, aesthetic preference, institutional inheritance, competition, and boredom. Then they begin the serious work and the serious work is usually the attempt to solve the problem. To automate that work and describe the remainder as more elevated is a form of consolation. It is the story a technological culture tells itself whenever it wants to believe that every subtraction is an advance.
There is also a psychological problem, and it may be the more important one. AI interaction has the structure of a slot machine. You ask. You wait. Something appears. It is plausible but not quite right, so you adjust the prompt and ask again. Another answer appears. Perhaps it is better; perhaps it is worse. You keep pulling the lever.
The reward is not understanding. The reward is movement. Something changed, something appeared, something feels closer. The mind receives repeated signals of progress without having performed the sustained work from which genuine understanding is formed. The process is active enough to be absorbing and passive enough to be degrading. It fills attention while weakening it. This is why the technology is so difficult to use well. It does not merely offer assistance; it encourages a particular rhythm of cognition that is fragmented, reactive, impatient, and dependent on external generation.
Error can provoke attention.
Plausibility sedates it.
The danger is not simply that the machine is wrong. A wrong answer can be useful; it can force the mind to wake up. The greater danger is that the machine is often right enough. It produces an answer coherent enough to accept and incomplete enough to prevent the formation of a real internal model. The user acquires the result without acquiring the path. The answer is possessed externally before it is understood internally.
When I derive something myself, I know where the uncertainty lives. I know which steps were obvious, which were difficult, which were fragile, and which remain unresolved. The structure of the solution is connected to the structure of my effort. When a machine supplies the path, I can inspect it, test it, verify parts of it but the epistemic relation is weaker. I possess the answer more easily than I possess the route by which the answer became necessary.
Over time, this matters. The mind is shaped by what it repeatedly does. A person who repeatedly confronts difficult problems develops patience, precision, independence, and tolerance for uncertainty. A person who repeatedly delegates the construction of solutions and evaluates the results develops a different set of habits: impatience, dependence, fragmented attention, and the expectation that difficulty should be discharged into an external mechanism as quickly as possible.
There are disciplined ways to use AI. One can use it as a critic, a verifier, a search tool, or a hostile reviewer. One can impose rules and preserve the difficult part for oneself. But this does not answer the objection. The existence of a controlled use does not change the character of the ordinary use. A slot machine can also be approached with discipline; that does not make it a good environment for cultivating patience.
The natural form of AI use is delegation. Its natural incentive is convenience. Its natural effect is to remove resistance. And resistance is not always the enemy. Some forms of resistance are the means by which the mind becomes capable of respecting itself.
For me, this is enough. I do not want to build elaborate rituals for ensuring that a machine designed to remove cognitive effort leaves me with enough cognitive effort to remain intact. I do not want to negotiate continuously with a tool whose central promise is that it will spare me the work I most value doing.
The issue is not purity. It is not nostalgia. It is not fear of progress. It is a decision about what kind of life is worth living.
A society can become more productive while its members become less capable of sustained thought. It can create more artifacts while producing weaker authors. It can generate more intelligence externally while cultivating less intelligence internally. This is not a contradiction. It is what happens when a civilisation confuses output with flourishing.
There are difficulties that should be removed. There are also difficulties that constitute the person who confronts them. I do not want to delegate those difficulties.
I do not want to think through machines.