‹ BackHN Continuity

Thread

Show HN: Fine-tune an 8B model on a 4 GB laptop GPU

135 points · 28 comments · MakazhanAlpamys

  1. victor106 · · focus · HN ↗
    How much data do you need to fine tune a model?
    1. MakazhanAlpamys · · focus · HN ↗
      Depends what you change. Format or style, few hundred rows is often enough. A task the model already half knows, few thousand.

      New facts is where people waste a week. The model comes back wrong in a new way. Use RAG for facts.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.