I'm loving the tit for tat cost charts these guys are doing. Just a few days ago it looked like OpenAI ruled the cost pareto frontier. Not even a week later and Anthropic is taking the charts again. See you guys same time next week?
Can't wait for it to get to the point where it's like an internet subscription: unlimited tokens 24/7/365 at a low, fixed monthly price.
It can't be unlimited because you can spawn parallel streams.
Anyway I think if you have a single stream of a cheap model, like GPT 6 Luna, I don't think you can currently exhaust it in a week on a $200 plan. I mean it only puts out so many tokens per second.
Unlimited but account-level throttled tps (more parallel streams means more throttling across all) is OK IMO, as long as it isn't too crazy. The thing that makes subscriptions really suck is having to watch the quotas, because prompt cache maintenance.
s3p · · focus · HN ↗
skeledrew · · focus · HN ↗
kingstnap · · focus · HN ↗
Anyway I think if you have a single stream of a cheap model, like GPT 6 Luna, I don't think you can currently exhaust it in a week on a $200 plan. I mean it only puts out so many tokens per second.
skeledrew · · focus · HN ↗