‹ BackHN Continuity

Thread

I think you should almost never use AI to write

363 points · 177 comments · erwald

  1. rootedbox · · focus · HN ↗
    The proposition that one should “almost never use AI to write” contains a fascinating little neurological trap: it assumes that the activity we call writing has one essential function.

    But does it?

    Writing certainly can be thinking. Anyone who has wrestled with a paragraph at three in the morning knows the peculiar phenomenon: you begin with an idea, and somewhere around the third comma you discover that you didn't actually have an idea. You had a mood wearing an idea costume.

    Excellent. Writing caught the bug.

    But why assume the biological hand that pushes words through a keyboard possesses some sacred monopoly on this process?

    For thousands of years, human beings have externalized cognition. We invented counting stones, writing tablets, books, maps, diagrams, calculators, libraries, laboratories, and—eventually—computers. Every one of these inventions moved some cognitive operation outside the skull.

    Nobody argues that using a calculator prevents mathematics because “the multiplication process is part of thinking.”

    Sometimes it does.

    Sometimes the calculator merely prevents you from wasting twelve minutes multiplying 487 by 36.

    The interesting question is therefore not Who typed the sentence? but Who did the thinking?

    And here the anti-AI argument becomes rather less certain.

    Suppose I write an argument and give it to an AI with instructions:

    Find every assumption I have smuggled in. Tell me where my argument contradicts itself. Give me the strongest argument against my position. Identify every sentence that sounds impressive while saying nothing.

    Have I stopped thinking?

    Or have I acquired a rather peculiar intellectual sparring partner who never gets tired, never needs coffee, and is perfectly happy to tell me that my brilliant insight is actually three clichés in a trench coat?

    The answer depends entirely on what I do with its response.

    If I obediently paste the machine's prose into an essay and call it my thinking, then yes, something important has been lost. But if I use the machine to attack my assumptions, generate alternatives, expose blind spots, and force me to make distinctions I had previously avoided, then the machine is not replacing the thinking process. It is perturbing it.

    And perturbation is where interesting things happen.

    Every nervous system operates through feedback. We don't think in isolation; we think through interactions with environments, symbols, other people, books, arguments, mistakes, and increasingly, machines.

    The human mind has never been a sealed container.

    The more interesting danger, therefore, isn't that AI will “write for us.” The danger is that we will stop noticing when we have handed over our judgment along with the prose.

    That distinction matters enormously.

    A calculator does not tell you what you should calculate. A spellchecker does not decide what you believe. A search engine does not automatically determine whether the evidence supports your conclusion. And an AI should not be granted the authority to do any of those things merely because it can produce a remarkably confident paragraph about them.

    But neither should we fetishize the struggle of producing every sentence manually.

    There is a strange technological superstition hiding here: the belief that cognitive labor becomes more intellectually authentic as it becomes more tedious.

    I don't buy it.

    The question isn't whether the machine touched the sentence.

    The question is whether you touched the idea.

    If an AI writes a paragraph that you blindly accept, you have delegated your thinking.

    If an AI writes a paragraph that makes you say, “Wait, that's bullshit,” and forces you to figure out exactly why it is bullshit, the machine has just helped you think.

    And perhaps that is the real reality tunnel worth examining.

    We have spent centuries confusing the tools of thought with thought itself.

    The printing press didn't kill thinking. The calculator didn't kill mathematics. The word processor didn't kill writing.

    Perhaps the genuinely dangerous technology is not the one that writes sentences.

    Perhaps it is the one that convinces us we no longer need to ask what the sentences mean.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.