‹ BackHN Continuity

Thread

AI chatbots give wrong answers to financial queries 'most of the time'

157 points · 89 comments · 1vuio0pswjnm7

  1. FinnLobsien · · focus · HN ↗
    The problem with LLMs in finance is the same as it is in writing, design, and many other disciplines: it isn’t code.

    Code objectively does what it‘s intended to do or it doesn’t (and passes certain tests or not) which gives coding agents an indication on whether their solution is adequate.

    This is much harder in almost any other discipline.

    Pass-fail tests in other disciplines are much less useful. You can tell an AI to not use certain words or not write sentences longer than X, but those rules are insufficient.

    At no point can a piece of writing or a design be evaluated to “work” the way code does.

    1. [deleted] · · focus · HN ↗

      [deleted]

    2. red-iron-pine · · focus · HN ↗
      finance is math. there are well understood models for this, and they're not surprising. It should be one area where AI dominates, since usually the finance questions are something to the effect of "will this make me more money, given the risk?" -- which can be measured and modeled, with code.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.