Thread

1. LarsDu88 · 1790704113 · focus · HN ↗

   Is this Astra running on Cerebras?

   1. mixel · 1790704277 · focus · HN ↗

      No this is just the 500$ plan. They offer "ultrafast" now which is ~300tps which is 8x the speed for 6x the price.

      1. LarsDu88 · 1790704602 · focus · HN ↗

         I think 300 tps might be roughly what an astra sized model would be at if running on Cerebras hardware no?

         Or are they simply lower the batch sizes on whatever hardware they are currently running?

         1. mixel · 1790706982 · focus · HN ↗

            Yeah sorry I misunderstood you. And yeah I bet that it is the cerebras collaboration although they didn't explicitly say this, maybe their own chip is fast enough for this inference speed? But I could only take a guess if its this or that

            1. LarsDu88 · 1790708773 · focus · HN ↗

               I doubt Jalepeno is in production at this scale yet. Cerebras has been touting their datacenter buildout for the past 9 months.

Unofficial Hacker News client; not affiliated with Y Combinator.