Thread

1. aliljet · 1786043929 · focus · HN ↗

   Is there a path to distill this model to do very specific things? Like a RAG strategy for a small (or even large) corpus?

   1. teravor · 1786045185 · focus · HN ↗

      once you are able to get the full probability distributions per token you can distill it on specific domains. distilling without that isn't generally a good idea unless you have invested millions in the requisite infrastructure.

Unofficial Hacker News client; not affiliated with Y Combinator.