Thread

1. minimaxir · 1790702170 · focus · HN ↗

   > Cached input costs just $0.10 per million tokens—95% less than standard input pricing and 50% less than GPT‑6 Sol’s cached input pricing

   This is the actual big announcement. 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

   1. joshstrange · 1790703602 · focus · HN ↗

      > 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

      Cache doesn't help you much when you are compacting every 5 minutes...

      I was shocked at how quickly I ran out my $100/mo subscription with a single agent (sol medium).

      1. redox99 · 1790706261 · focus · HN ↗

         If you run out of sol medium with $100 you're doing something wrong. Astra destroys your usage, I get 1 day of usage with Astra, but 6 sol is almost unlimited and I only use xhigh.

         1. shimman · 1790709072 · focus · HN ↗

            "You're holding it wrong." Is hardly a retort from a real paying customer having problems with their paid services.

            This is why these companies are struggling to make money, they're chastising their customers just like they've been chastising the human race.

            1. trio8453 · 1790718639 · focus · HN ↗

               > "You're holding it wrong." Is hardly a retort from a real paying customer having problems with their paid services.

               It's very appropriate in the cases when you're holding it wrong. The fact that you're paying doesn't mean that you can't make mistakes or waste resources.

               1. shimman · 1790780715 · focus · HN ↗

                  I don't find it appropriate at all, especially regarding technology that workers deeply hate and are skeptical of.

                  If this is how you want to get people on your side, I can understand why the entire country/human race are against these companies.

                  1. trio8453 · 1790800039 · focus · HN ↗

                     Sides? Hate? This is all very emotional. Try to put the facts down plainly and see how ridiculous it is --

                     It's a product and if you're using it incorrectly, we can either

                     1. say so

                     2. pretend that you don't so to get/keep you on "our side"? or not say is because you're skeptical or hate it? (how does that last bit even follow logically?)

                     How is 2 better in any way for anyone involved?

               2. crossroadsguy · 1790832995 · focus · HN ↗

                  [delayed]
            2. Anonasty · 1790759784 · focus · HN ↗

               Literally the prompting and task definition is main variable how LLM's performs. There are literally millions of examples of vibe coders and new AI adopters who run out of tokens since they don't know how the LLM's work.
         2. jorblumesea · 1790713369 · focus · HN ↗

            yeah I use sol constantly and have done maybe $15 of spend in the past week. it's solid and cheaper. this is at least 4-5 investigations, prs, whatever per day.
         3. Aeolun · 1790718129 · focus · HN ↗

            It’s only nearly unlimited if you haven’t just used a banked reset. After a banked reset your weekly usage gets cut by about 80% (not the week you need to wait to get your normal limits back though). ChatGPT has given me a really good reason to cancel.

            1. threecheese · 1790722893 · focus · HN ↗

               Can you elaborate? I've been getting great usage out of my $200/mo plan, and thought I'd try a reset (first time) which was expiring just for giggles. Am I going to get only 20% of it effectively?

               I overused Astra in order to drain my weekly, figuring I'd have the reset. (not wastefully, I did get more work done)

               1. Aeolun · 1790763407 · focus · HN ↗

                  I can’t say what will happen to you, but yes, that has been my experience. It is better to wait for your normal full limit to return, because if you use a banked reset you get only 1/5th of the tokens but you still have to wait the full week afterwards for it to reset. 20% would be fine if it didn’t also reset the date your normal reset fires.

                  1. seunosewa · 1790784586 · focus · HN ↗

                     Banked resets do expire if you don't use them, so use them anyway.
                  2. nkmnz · 1790786738 · focus · HN ↗

                     Did you “earn” that reset on a lower tier?
                  3. edot · 1790834998 · focus · HN ↗

                     Proof? Like, do you have logs or something? Not calling you a liar but this seems not correct based on my usage.
         4. mattkenefick · 1790774037 · focus · HN ↗

            How do you get 1 day of usage with Astra?

            I create a lot, but I can make a full month with Astra on the current Pro plan. What are you doing to spend that much?

            1. redox99 · 1790774753 · focus · HN ↗

               Currently spending a lot of tokens programming the AI for my videogame.

               1 day is kind of generous, it probably lasts like 12 hours of running non stop.

Unofficial Hacker News client; not affiliated with Y Combinator.