‹ BackHN Continuity

Thread

Show HN: Mini-AGI – Dynamic continual learning model trained on 8GB VRAM

277 points · 81 comments · volotat

  1. lostmsu · · focus · HN ↗
    This is slop. 8M parameter dense model with context length 64 that you train on enwik9 in 2h will have 1.15 bpb. This model has 1.8 (bits per byte, lower is better).
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.