Thread

1. gizmodo59 · 1785843607 · focus · HN ↗

   The web and connecting to other services is very important for almost all of my use cases. While I believe we are going to get better and faster models, the web index is certainly not downloadable and maintainable for 99.99% of the folks who are able to use local models. Any good solutions exist?

   1. pbronez · 1785849911 · focus · HN ↗

      There are many search APIs available, I like Kagi's.

      Microsoft and Amazon both provide web snapshot services that purport to give you a kind of agent-first internet archive. You can approximate something like that using common crawl, but it's a huge amount of data. Downloading the internet is impossible or a bad idea for almost everyone.

   2. morgoo · 1785850532 · focus · HN ↗

      If you're really into self-hosting I've been experimenting with SearXNG and early signs are promising

Unofficial Hacker News client; not affiliated with Y Combinator.