‹ BackHN Continuity

Thread

I built non-autoregressive decision models with RL a year ago

1363 points · 319 comments · nandakishor_ml

  1. prometheus1992 · · focus · HN ↗
    I think the main gripe that people had with Jev and Typesafe was the language used when they launched. To me personally it seemed like a parody/con/shady at first.

    "Breakthrough", "our research went in another direction" , "Two years in stealth", "System One thinking model", "Jev can't hallucinate", "RLCD","We are doing very cool stuff, but we will have to hire you to tell you", - these are some of the things that they said on their website on the launch blog.

    I had used versions of bert to achieve the same functionality years ago. But to me it seems like they were able to trick the VCs with "can't hallucinate" etc.

    To the above author, kudos for sharing your work and making it open. Something like this shouldn't be closed in the first place when it has been available for so many years

    1. wild_egg · · focus · HN ↗
      Last time I did anything with a BERT, you had to train or fine-tune. Is that not still true?

      For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.

      Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.

      1. evrydayhustling · · focus · HN ↗
        We used to use BERT-based embeddings + semantic distance for classification / decision problems in new domains. There was a lot of interest at the time in these kinds of pre-generative but portable models -- Meta's Prophet was another example that came up a lot.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.