Thread

Transformers Explained Visually

663 points · 92 comments · aray07

jasonjmcghee · 1790029269 · focus · HN ↗
For the uninitiated, I can't recommend enough, The Illustrated Transformer:
<a href="https://jalammar.github.io/illustrated-transformer/" rel="nofollow">https://jalammar.github.io/illustrated-transformer/
1. hangonhn · 1790032938 · focus · HN ↗
  His book is also very good: <a href="https://www.amazon.com/Hands-Large-Language-Models-Understanding/dp/B0F7JW92ML" rel="nofollow">https://www.amazon.com/Hands-Large-Language-Models-Understan...
  1. misiti3780 · 1790036466 · focus · HN ↗
    seconded, the book is very good.
    whattheheckheck · 1790044218 · focus · HN ↗
    When people say a book is good what does that mean? Good for infotainment? To get an intuitive understanding? To be able to open up Openthropic and compete against the frontier labs? What can you get in the book thats not available via a chatbot? Interesting question
    misiti3780 · 1790079539 · focus · HN ↗
    well i cant speak for anyone else, but I can tell you there are quite a few books on transformers etc and this one does the best job of explaining how the guts (attention heads etc) work. has it good visualizations too
  2. neilv · 1790038289 · focus · HN ↗
    DRM-free EPUB and PDF (for those who'll pay double to legally avoid Kindle DRM):
    <a href="https://www.ebooks.com/en-us/book/211460386/hands-on-large-language-models/jay-alammar/" rel="nofollow">https://www.ebooks.com/en-us/book/211460386/hands-on-large-l...
2. israrkhan · 1790039889 · focus · HN ↗
  Excellent resource for beginners
3. vitaljudge · 1790053746 · focus · HN ↗
  thank you
4. [deleted] · 1790100328 · focus · HN ↗
  [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.