Can also say the year that subscriptions go down, because now you can finally build your own systems exactly to your liking. Save money and have something that works just for you. LLMs are awesome.
good question. maintenance is cheap with tools like astra/opus. also, these aren't production level applications, so I don't need to worry about it being "perfect" (though there's no such thing)
What happens when these companies decide to start increasing the cost/token, exceeding the cost of hiring an engineer or paying for an external service in the first place?
Cost per intelligence-adjusted token has been in free-fall since GPT-3 landed five years ago [0]. I see no compelling reason to think we'll see that trend suddenly stop, much less reverse.
0. "The cost of achieving a given level of AI performance has fallen about 47% per quarter since 2023, or 13× per year."
<a href="https://epoch.ai/publications/the-plunging-price-of-thought" rel="nofollow">https://epoch.ai/publications/the-plunging-price-of-thought
Or they optimize the model for just one more hit, er, prompt. All these AI companies are backed by the same companies optimizing revenue via addiction.
So, same end result (cost exceeds hiring a new engineer), but achieved differently.
The counter, I suppose, is the managers have to deal less with engineers telling them their ideas aren't good or well thought out.
saadn92 · · focus · HN ↗
phinnaeus · · focus · HN ↗
saadn92 · · focus · HN ↗
ironman1478 · · focus · HN ↗
istjohn · · focus · HN ↗
0. "The cost of achieving a given level of AI performance has fallen about 47% per quarter since 2023, or 13× per year." <a href="https://epoch.ai/publications/the-plunging-price-of-thought" rel="nofollow">https://epoch.ai/publications/the-plunging-price-of-thought
oblio · · focus · HN ↗
oblio · · focus · HN ↗
What do you mean? They need to recover hundreds of billions in sunk costs?
spit2wind · · focus · HN ↗
So, same end result (cost exceeds hiring a new engineer), but achieved differently.
The counter, I suppose, is the managers have to deal less with engineers telling them their ideas aren't good or well thought out.
saadn92 · · focus · HN ↗
1.) open weight models gain more popularity 2.) i'm making more money from these models than paying for them
if either happens, then I'll feel good about it either way