Thread

1. nl · 1790899033 · focus · HN ↗

   > Epistemological weirdness

   > They are also notably bad at judging the historical significance of what they find.

   I use LLMs for some things that are outside the more common use-cases (in my case 3D design for 3D printing) and one thing I've noticed is that the errors it makes are so completely unlike human errors that they are hard to anticipate.

   It will do things like build perfect snap catches but put them so the the pieces they are connecting are rotated 90 degrees from how they should be. It's "dumb" error, but hard to say the model itself if dumb because it does other very hard things so perfectly.

   > seven chord groups

   This sounds a lot more like Opus 5.0 than Opus 5.5 TBH. I wonder if that was an earlier investigation because 5.5 has improved that kind of language a lot.

   1. morpheos137 · 1790902744 · focus · HN ↗

      In general llms are weak with spatial reasoning. This seems to be an unsolved problem. Probably because human language is generally imprecise spatially and humans think about spatial problems in visual terms. I wonder if having an llm make a 3d design in a format an image model could check would result in a better outcome?

      1. Aerroon · 1790906321 · focus · HN ↗

         Is it that LLMs are weak with spatial reasoning (and memory) or is it that we are unusually good at it?

         When I need to use a program I seldomly use I'm far more likely to remember where I need to click to open it than the word I need to search for to open it.

         1. kfarr · 1790912323 · focus · HN ↗

            Yes I like to think of humans with built-in accelerators for certain tasks -- our visual and spatial reasoning is off the charts presumably because it's a life or death skill!
         2. treis · 1790948417 · focus · HN ↗

            I made a building and had astra fill out the interior of the bathroom with toilets. It put 6 of them in two rows back to back with no way to reach the second row. Other than climbing over the stalls of the first row I suppose.

            So yeah, they are very weak at spatial reasoning.

Unofficial Hacker News client; not affiliated with Y Combinator.