Thread

Clef: Open-weight decision models, and new RL fine-tuning platform

637 points · 217 comments · jasondavies

vulture916 · 1790884845 · focus · HN ↗
Jev = $0.042/m input, output free Clef = $0.24/m input, no output price listed
At 300 tokens per call, you'd get:
One million decisions on Jev cost about $12.60. One million decisions on Clef cost about $72.
Would probably make sense to self-host Clef, if you have the capability/resources. If not...
1. Havoc · 1790926921 · focus · HN ↗
  >Would probably make sense to self-host Clef
  For privacy perhaps but on pricing you're unlikely to come out ahead versus datacentres with scale and industrial power pricing
  1. otabdeveloper4 · 1790933458 · focus · HN ↗
    That's what they originally said about AWS too.
    Turns out AWS is actually about 10 times more expensive than renting your own datacenter compute.
    Havoc · 1790948419 · focus · HN ↗
    You’re not really paying for just the compute in AWS though. You’re paying for compute that comes with 200 integrated ready to go other products and stuff like compliance and certifications.
    It’s like comparing pricing of a ribeye at the butcher and on restaurant menu. It’s apples and orange.
    Certainly AWS is making good money too though. And yeah if you just need a VM then AWS isn’t the way

Unofficial Hacker News client; not affiliated with Y Combinator.