I am positive I know exactly how this works, I made something similar a few months back. But the problem is without generation you are extremely limited in the use cases. And while the model can't hallucinate, it can still be wrong. It just can't make up data.
This is basically what they have. <a href="https://github.com/fastino-ai/GLiNER2" rel="nofollow">https://github.com/fastino-ai/GLiNER2
adroitboss · · focus · HN ↗
dennisy · · focus · HN ↗
adroitboss · · focus · HN ↗
krackers · · focus · HN ↗
adroitboss · · focus · HN ↗