Small LM trained on Tiny Stories. My first goal was to get people to see tokens from the model ASAP, the second was to demo Tiny Stories for those who may be unfamiliar. Oh and play with ternary models. <a href="https://arxiv.org/abs/2305.07759" rel="nofollow">https://arxiv.org/abs/2305.07759
There's larger QA model on the same page too.
atobe · · focus · HN ↗
Small LM trained on Tiny Stories. My first goal was to get people to see tokens from the model ASAP, the second was to demo Tiny Stories for those who may be unfamiliar. Oh and play with ternary models. <a href="https://arxiv.org/abs/2305.07759" rel="nofollow">https://arxiv.org/abs/2305.07759
There's larger QA model on the same page too.
logicallee · · focus · HN ↗