‹ BackHN Continuity

Thread

The LLMentalist Effect (2023)

235 points · 309 comments · jalev

  1. mstank · · focus · HN ↗
    This is a strange newsletter post. It’s harping against AI but seems AI-written itself.

    Its ultimate conclusion:

    “I’ve come to the conclusion that a language model is almost always the wrong tool for the job.

    I strongly advise against integrating an LLM or chatbot into your product, website, or organisational processes.”

    Seems so obviously biased that I can only understand it with the context that the writer is trying to sell their book for €35

    1. ryuuseijin · · focus · HN ↗
      The post makes sense for 2023. Today, not so much.

      Also, definitely not AI written if the date is accurate.

      1. scotty79 · · focus · HN ↗
        > Also, definitely not AI written if the date is accurate.

        Which is hilarious.

        1. pixl97 · · focus · HN ↗
          Hacker News, successfully detecting 375 out of 4 AI written articles.
    2. mstank · · focus · HN ↗
      Just realized this was written in 2023. Can’t believe how wrong we were about AI back then.
      1. JoshTriplett · · focus · HN ↗
        Can't believe how right we were, too.
        1. daishi55 · · focus · HN ↗
          You seem to be winking a little bit and I’m not sure exactly what you’re trying to say, but I agree with the one you are replying to: the author of this article wrote a lot of words - like a lot a lot of words - only to look very foolish a short time later. And I think much ink was similarly spilled writing very similar piece smirking at people who thought LLMs could do real intellectual work. And they were all wrong.
          1. JoshTriplett · · focus · HN ↗
            It is absolutely the case that some things people wrote about AI and LLMs in the past is no longer true; it's a fast-changing area.

            It's also the case that some things remain true. If someone says "don't use them for X because their quality isn't good enough", that's a recommendation with an expiration date. But if someone says "don't use them for X" for any number of other good reasons, that recommendation is often timeless.

            "Can it" is changing rapidly. Much more rapidly than "Should it".

            1. daishi55 · · focus · HN ↗
              Can you give an example of some of these things?
            2. rpdillon · · focus · HN ↗
              > But if someone says "don't use them for X" for any number of other good reasons, that recommendation is often timeless.

              Are the good reasons timeless? I guess it's hard to parse what you're saying without some concrete examples. Is there any advice about what to use them for from 2022 or 2023 that you feel is true today, and you expect will be timeless? You said "often", so I'm assuming there are a handful of examples.

              Ultimately though, this is not an objective discussion, since we're talking about "should", so I'm mainly asking out of curiosity on your view of things. The main example I can think of today is that you shouldn't do professional prose writing with LLMs. Obviously the models have gotten better, but writing is one of those areas where it produces middling output, though even here I hesitate because with a 21% illiteracy rate, it writes better than many adults in the US.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.