‹ BackHN Continuity

Thread

A single function Jev-like wrapper for LLMs, including vision models

157 points · 45 comments · allanrbo

  1. prathje · · focus · HN ↗
    Nice! I would love to use it for images as well. Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching? Because then I have been using that already…
    1. ulam2 · · focus · HN ↗
      Yes, that is my question too. Someone knowledgeable can comment
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.