Thread

1. brap · 1790152627 · focus · HN ↗

   What I don’t understand is, why would you not want “reasoning” in a classifier?

   Speed and cost are obvious reasons, but isn’t this a tradeoff?

   1. ph1l337 · 1790153990 · focus · HN ↗

      not sure if true, but if you look at laya they use BERT type models. If jev is also using a BERT-type model it is autoregressive and therefore can't reason in the way that GPT-type models can. However, you get the advantage of being able to attend in both directions.

Unofficial Hacker News client; not affiliated with Y Combinator.