Thread

Hister: A private search engine for the pages you visit and the files you keep

741 points · 202 comments · bookofjoe

Loading the complete thread in the background. This saved snapshot is available now. Refresh

jammaloo · 1789663881 · focus · HN ↗
A recent discussion about this tool
<a href="https://news.ycombinator.com/item?id=49351802">https://news.ycombinator.com/item?id=49351802
evilduck · 1789664437 · focus · HN ↗
Saw on Discord that they have to change their name, since <a href="https://histre.com" rel="nofollow">https://histre.com sent them a letter.
tamimio · 1789664602 · focus · HN ↗
Integrate it with linkwarden so it search the bookmarked pages.
1. billbrown · 1789665982 · focus · HN ↗
  It does that already. <a href="https://hister.org/docs/import#importing-from-linkwarden" rel="nofollow">https://hister.org/docs/import#importing-from-linkwarden
  1. tamimio · 1789666839 · focus · HN ↗
    Thanks, that looks interesting, I will test it out and see if it continuously sync or must be manually imported from time to time, or if it can replaces linkwarden entirely. My linkwarden instance also saves as a pdf not just html and bookmarks are in GB in size, if hister does it more efficiently it’s even better.
361994752 · 1789667001 · focus · HN ↗
I had the same problem for a very long time but it is largely solved now. I started to simply ask chatgpt "hey I read something about x, y month ago but can't find it now". There is a surprisingly high chance chatbot can just give the exact answer back to me, usually with extra interesting reading materials as a plus.
1. cobertos · 1789667206 · focus · HN ↗
  Is all your browsing history already with chatgpt or something?
  This has an MCP server specifically so a workflow like that would work for you. This is just made to gold the data, and I'm a human accessible way should your AI fail you
  1. 361994752 · 1789667371 · focus · HN ↗
    No I don't share anything with chatgpt. But I do have a $20 subscription, if it matters. I feel It's just capable enough to find what I want from my usually vague and inaccurate description.
    itsdesmond · 1789677173 · focus · HN ↗
    Or something similar enough to what you wanted that you don’t notice it’s a different thing. That’s awful.
2. rglullis · 1789667348 · focus · HN ↗
  And now you are even more dependent on OpenAI...
  You didn't solve the problem, you are just trading pain points.
  1. randomblock1 · 1789667472 · focus · HN ↗
    Nothing about this depends on the provider, you could spin up a local Qwen and give it a search tool like SearXNG or something. At this point local models are more than good enough for simple tasks like that. Using ChatGPT is just (usually) faster and simpler
  2. 361994752 · 1789667600 · focus · HN ↗
    There should be no real vendor lock in in my opinion. You can ask the same question with pi + qwen (or any harness + good enough model) with internet access and it will work. Chatgpt is just one option came in handy.
  3. pixl97 · 1789669075 · focus · HN ↗
    "Goddammit, I'm wholly dependent on Merriam-Webster, what ever am I going to do".
bradrn · 1789667221 · focus · HN ↗
Ooh, very nice! I have my own tool I’ve been using for this [<a href="https://github.com/bradrn/full-history-search/" rel="nofollow">https://github.com/bradrn/full-history-search/], and it’s incredibly useful, but it’s also pretty primitive. This one looks a lot nicer.
jval43 · 1789667302 · focus · HN ↗
Google Chrome did this in 2008. Full-text search over all visited pages, stored offline. It was very useful and I miss it.
Nobody seems to remember it, even though it was a headline feature. Was removed in 2013, I think due to technical constraints.
Will definitely try this.
1. xd1936 · 1789667626 · focus · HN ↗
  I remember this as well. I hadn't noticed it was gone until just now, but you're right.
  Edit: Found it. Thanks Claude.
  <a href="https://github.com/ssnangua/google-chrome-comic-hd/blob/main/english/images/19.jpg" rel="nofollow">https://github.com/ssnangua/google-chrome-comic-hd/blob/main...
  <a href="https://dfir.blog/history-index-files-removed-from-chrome-v30/" rel="nofollow">https://dfir.blog/history-index-files-removed-from-chrome-v3...
  1. jval43 · 1789668075 · focus · HN ↗
    Funnily enough, the Chromium documentation hasn't been updated in 18 years and still has the original screenshots and description: <a href="https://www.chromium.org/user-experience/history/" rel="nofollow">https://www.chromium.org/user-experience/history/
2. varispeed · 1789669147 · focus · HN ↗
  > I think due to technical constraints.
  I think due to shareholders wanting new sportcars. The offline pages don't show Google Ads.
3. wtallis · 1789670539 · focus · HN ↗
  There was also Google Desktop Search for several years: <a href="https://en.wikipedia.org/wiki/Google_Desktop" rel="nofollow">https://en.wikipedia.org/wiki/Google_Desktop
  1. thereforegrin · 1789714389 · focus · HN ↗
    with RCE and no privacy
    TeMPOraL · 1789716906 · focus · HN ↗
    I.e. like any good tool?
4. corney91 · 1789677710 · focus · HN ↗
  Now Chrome can't even remember what addresses you went to more than 90 days ago. It's such a nerfed browser.
  1. iririririr · 1789677794 · focus · HN ↗
    Still boggles my mind that people went from ridiculing people who installed Ad companies browser toolbars, to actually running their browser.
    93po · 1789678364 · focus · HN ↗
    When chrome was literally first released it was in fact faster than IE and Firefox, by quite a lot, and had some nice features that neither had, too. But that gap didn't last for long.
    iririririr · 1789864970 · focus · HN ↗
    lol. it amuses me how much people are the marketing and now forces themselves to remember it wrobg.
    when it launched it was fast because it had LESS features.
    jval43 · 1789680917 · focus · HN ↗
    It was so much faster you could not believe it. It was a revelation and even though "degoogling" was already a thing, Chrome was so much better than the rest that you just had to use it. Tabs actually worked without crashing your PC.
    The risks were clear from day one but Google and Chrome were great to both users and devs, and it stayed like that for a long time.
5. iririririr · 1789677751 · focus · HN ↗
  IE5 only on the mac, did this too.
6. ericol · 1789683230 · focus · HN ↗
  Not sure if the same product. I think the one I used was Google Desktop.
  I even hacked it for a company I was working for at the time: I installed it in a machine that had a lot of pdfs from some other client company of them.
  I don't recall the exact details, but I did some sort of proxying between the Microsoft Web Server that came with NT? at the time and G Desktop, and then an entire team of first support agents had almost instant search across all those docs. Good times.
7. TeMPOraL · 1789716814 · focus · HN ↗
  Now we have no browser capable of searching in anything - not even Firefox. I routinely try, in several browser, to find a tab among open tabs, a bookmark among open bookmarks, or a history entry (both from "omnibox" and dedicated history pane), and it never seems to find it - not by name, not by URL - until it gets a 100% unique match.
  It's like there's a timer or a cache somewhere, with aggressive limit, saying "only scan these top 100 results and then abort if it takes more than 10 ms to findf anything", or something. Making this completely useless.
  That's on top of occasional deletion of browsing history past few weeks.
  1. vbarrielle · 1789718814 · focus · HN ↗
    Have you tried searching with @tabs, @bookmarks or @history? It works reasonably well for me.
    TeMPOraL · 1789732076 · focus · HN ↗
    Yes. Try it regularly, against inputs I know correspond to things visited or bookmarked within last couple months. Almost never gives the actual result unless it's literal full-string match. That's why I'm complaining.
  2. negura · 1789725100 · focus · HN ↗
    Maybe stop using the mickey mouse browsers? I mean Firefox is pretty much a lost cause.. I agree those are basic features and in qutebrowser I use them reliably all the time. E.g press T (keybinding for :tab-focus command) - type keyword (matches against tab ID, page title, page URL & the tab's process ID) - press Tab - menu is populated with results - cycle through them using Tab/Shift+Tab - press Enter to jump to it. Similar workflow for history, different bookmark types, etc. History can also be loaded as an HTML page and jumped through with regex, etc.
  3. arantius · 1789838091 · focus · HN ↗
    For things I access often, the Firefox address bar does function like a near-perfect search for me. Some things I type [ab cd] and the page with the words _starting_ ab and cd pops right up.
    A while back I looked up a manual for an old Singer sewing machine, which turned out to be the model 15. So I typed [sin 15] in the address bar and -- yep, first result! A week ago I looked into the game Metroid Dread. Typed [met dre] and two relevant pages from my history came up, immediately.
    I don't know what you mean by "100% unique match" but, this feature works for me, and in fact I regularly use it and find it very worthwhile.
    arantius · 1790519125 · focus · HN ↗
    No one will ever see this (probably) but I remembered this comment, and just had this experience:
    I've been learning the eBay developer APIs. Recently (i.e. within the past few hours) I looked up the "Browse API" specifically. My first or second try failed so I typed just [ebay brows] and didn't find it! But when I finished [ebay browse] that document (within ebay.com and titled "Browse API | eBay Develo...") did show up!
    I can't reproduce now so I can only guess but it's possible this was a timing thing. I was typing several things, and changing/re-typing "as soon as" I did or did not see what I wanted to show up. But there was definitely a moment where I'd expect "that page I just had open an hour ago" to be at the top, but instead search suggestions (ugh, search in the address bar ...) were all that was showing.
  4. witrak · 1790003202 · focus · HN ↗
    I'm not sure what exactly you mean by saying "I routinely try, in several browser, to find a tab among open tabs, a bookmark among open bookmarks," but if you - like me - keep hundreds of open tabs in a couple of dozen windows and you can't find the tab you need at the moment, then you may be happy with the Firefox extension tabFx...
Lio · 1789667344 · focus · HN ↗
This is really cool. I like the idea of combining it with a offline Wikipedia cache.
RobGR · 1789667640 · focus · HN ↗
I've been using this since the last time it came up on here. I don't have it index every page I visit, I use the browser plugin to tell it to index specific ones. It is useful for sure, but I think it will really shine once I've been using it long enough for it to build up a bigger index of things that are old enough that I've actually forgotten about them.
asciimoo · 1789667779 · focus · HN ↗
Ohi, author here! Thanks for posting Hister. Feel free to A.M.A. My first free software search project was Searx, a privacy respecting metasearch engine, but because of the limitations of the metasearch concept, I've decided to take a different approach.
Hister builds a personal search index from pages you visit, bookmarks, browser history, local files, and crawled websites. It stores extracted content with offline result previews, so information remains searchable even when the original page changes or disappears. It supports full text and semantic search, can run entirely on your own machine, and includes a web interface, command line tools, and an MCP endpoint for assistant integrations.
Website: <a href="https://hister.org/" rel="nofollow">https://hister.org/
Tiny read-only demo: <a href="https://demo.hister.org/" rel="nofollow">https://demo.hister.org/
Ps.: It looks like our name conflicts with a registered trademark in the US. The owner of the other project has asked us to change it, so we’ll probably need to comply sooner or later.
Name suggestions are welcome! Ideally, the new name should be relatively short, sound good, and have an available .org domain.
Thanks!
1. Capricorn2481 · 1789668537 · focus · HN ↗
  Thanks so much for this, I'm using it all the time. I self host a few things, but I'm using this the most.
2. adfm · 1789668545 · focus · HN ↗
  histro.org is available.
  1. asciimoo · 1789668691 · focus · HN ↗
    Unfortunately, it is still considered too similar from a legal standpoint.
    adfm · 1789669466 · focus · HN ↗
    In that case, clipshot.org is also available.
    juliend2 · 1789693613 · focus · HN ↗
    [delayed]
    _kidlike · 1789713308 · focus · HN ↗
    that exactly how the Greek word sounds :)
    ιστορία, if you wanna copy paste.
    and yes, the English word comes from the Greek word!
    golem14 · 1789694621 · focus · HN ↗
    I doubt it. Trademark “infringement “ only happens when the two parties compete in the same space. I think if the other party is the music party game, you’re pretty much in the clear. They may still sue you and lose unless you cave.
    TaLiTr · 1789739954 · focus · HN ↗
    Nothing stopping them from threatening an open-source dev. The ""recent"" incident of Hoarder rebranding to Karakeep comes to mind.
    golem14 · 1789926853 · focus · HN ↗
    Exactly. We should have a general kickstarter-like fund for cases like this. Maybe John Oliver is interested :)
3. corndoge · 1789668567 · focus · HN ↗
  Are you aware of ArchiveBox?
  <a href="https://archivebox.io/" rel="nofollow">https://archivebox.io/
  What does Hister do differently? Search seems like a major differentiator, I'm wondering if leveraging the existing archivebox project for archival and implementing good search on top would be more efficient
  1. asciimoo · 1789670961 · focus · HN ↗
    The main difference I see is Hister focuses on creating an active knowledge base and finding information quickly, while ArchiveBox focuses on preserving web content for the long term.
    corndoge · 1789698461 · focus · HN ↗
    Thanks for answering. Do you think these dovetail? I only want one archive, having two separate archives because one focuses on search and the other on long term archival is inefficient. What do you do for long term archival - or do you not have this use case?
4. dbliss · 1789668659 · focus · HN ↗
  Does it work accross multiple computers? Ideally the service runs on a linux box on my tailnet, and my windows and mac systems share the same server.
  1. asciimoo · 1789668808 · focus · HN ↗
    Sure, as long as you (and the browser extension) can reach the server, it can be used from as many machines as you want even in a multi-user setup.
    nottorp · 1789673433 · focus · HN ↗
    "Optional global or personal access token used to authenticate extension requests."
    Looks like you can even set authentication up so you can run it at home but connect while you're away too...
5. dwedge · 1789668719 · focus · HN ↗
  It feels like I'm the only person using this but I'd like to throw another potential bookmark manager integration into the ring, cherry <a href="https://github.com/haishanh/cherry" rel="nofollow">https://github.com/haishanh/cherry
  1. pava0 · 1789673107 · focus · HN ↗
    Not even a readme?
    dwedge · 1789676701 · focus · HN ↗
    Never even noticed that was missing and it's probably why nobody else uses it. I took it from <a href="https://www.reddit.com/r/selfhosted/comments/xyepiu/cherry_an_open_source_selfhostable_bookmark/" rel="nofollow">https://www.reddit.com/r/selfhosted/comments/xyepiu/cherry_a... and <a href="https://cherry.haishan.me/" rel="nofollow">https://cherry.haishan.me/ and just worked from the Dockerfile
6. danielrmay · 1789670534 · focus · HN ↗
  Thanks for making Hister, I've been using it for a few days (~7k docs) and I'm impressed so far.
7. Anonymous106 · 1789671281 · focus · HN ↗
  Histerekishi / Histereki - れきし/歴史 means history in Japanese. reki れき/歴 is a suffix which means (history of) Histeri MyHister(i) Hyster(y)
8. Beijinger · 1789671969 · focus · HN ↗
  "It looks like our name conflicts with a registered trademark in the US. "
  So? Where are you based? For what class was the trademark filed? When was it filed?
  I doubt that he has any leverage, but I don't know the background.
9. asdfqwertzxcv · 1789672310 · focus · HN ↗
  Thanks so much for creating this. Installed last time it was posted and have been loving it. The MCP server and extensions and userscripts are great QOL additions, as well. Always wondered if something was out there like this and you answered my prayers! New name suggestion: MisterHistory
10. Beijinger · 1789672418 · focus · HN ↗
  "No mandatory cloud - A complete personal setup can run on one local machine."
  How does it sync via several computers?
  1. al_hag · 1789674460 · focus · HN ↗
    Tailscale is one option
    michaelje · 1789699562 · focus · HN ↗
    I built something similar at the start of the year, using tailscale for auth (multi user on my tailnet/home network) and for access wherever I was, whether at home or on the road (all compute/storage was on my Mac mini.) Worked a treat.
11. jamienk · 1789672742 · focus · HN ↗
  Would like: * Local web page interface or even browser UI element (since extension needed anyway) * Ability to add notes to history * Flag if bookmarked, allow filtering "bookmarks only" * Keep old versions of pages * Human-readable text diff vs current live page
12. yeahdef · 1789672845 · focus · HN ↗
  "hister 2: histlectric histerloo"
  1. mxuribe · 1789673616 · focus · HN ↗
    [delayed]
13. swyx · 1789673103 · focus · HN ↗
  is this like a pihole? is there a design difference you are going for here?
14. Cider9986 · 1789673357 · focus · HN ↗
  [delayed]
15. john_strinlai · 1789674101 · focus · HN ↗
  >Ps.: It looks like our name conflicts with a registered trademark in the US.
  do you have a link to that trademark?
  the only one i see containing "hister" is <a href="https://tmsearch.uspto.gov/search/search-results/98575798" rel="nofollow">https://tmsearch.uspto.gov/search/search-results/98575798 which is "dead" and "abandoned".
  "This trademark application was refused, dismissed, or invalidated by the Office and this application is no longer active."
  the only other similar-ish ones ("historix") appear to be in different domains (e.g. translation services).
  if you're tied to the name, it's probably worthwhile digging deeper.
16. mxuribe · 1789674323 · focus · HN ↗
  Hi @asciimoo , related to a name suggestion, how about something like...
  * chronilog.org ...as in, a log of one's chronicles.
  * And if you will include this into KDE, then can use a 'k' instead, such as kronilog.org :-)
  Both seem to be available. ;-)
  1. asciimoo · 1789674764 · focus · HN ↗
    This is a great suggestion, thanks! I'll definitely add it to the list of candidates. My plan is to do a vote on our social platforms if we have a few decent candidates.
    consumer451 · 1789677292 · focus · HN ↗
    [delayed]
    pidgeon_lover · 1789718457 · focus · HN ↗
    What about Krionicle? References Chronological Chronicle, cryo- (freezing knowledge for later use), and a robotic toy from 2001
    skripp11 · 1789725636 · focus · HN ↗
    Unless you are really strapped for cash, register all the candidates before you start that voting.
17. elektor · 1789675046 · focus · HN ↗
  Hi asciimoo, seems like this is the second time Hister is hitting the HN front page in a month, so congrats on the success!
  Question for you: For the less tech savvy of us on here, is there any chance Hister can be can hosted on something like Pikapods? <a href="https://www.pikapods.com/" rel="nofollow">https://www.pikapods.com/
  1. asciimoo · 1789675958 · focus · HN ↗
    Yes, that's something I'd like to support. The main missing piece for a user-friendly hosting option such as PikaPods is a configuration UI. At the moment, customizing Hister requires editing a configuration file, which isn't practical for this kind of hosted service.
    elektor · 1789676618 · focus · HN ↗
    Appreciate the response! I'll be eagerly following Hister's progress. For now, I've settled on a mix of Instapaper and using SingleFile uploads to Dropbox.
    cyanlimetea · 1789690693 · focus · HN ↗
    [dead]
18. mircea · 1789675309 · focus · HN ↗
  On HN does it capture both the HN post page and the target page?
  E.g.: for this submission I would want both <a href="https://news.ycombinator.com/item?id=49743097">https://news.ycombinator.com/item?id=49743097 and <a href="https://github.com/asciimoo/hister" rel="nofollow">https://github.com/asciimoo/hister captured.
  1. asciimoo · 1789675739 · focus · HN ↗
    The extension captures the content of the opened tabs, it does not create new requests. If you open both, it captures both.
    iririririr · 1789677653 · focus · HN ↗
    You may be the first "search engine" capable of indexing instagram and other closed sites.
    asciimoo · 1789678337 · focus · HN ↗
    Exactly, this is the biggest advantage of the extension. It is fully invisible for the websites, so no captcha, anti-bot protection, no authentication issues, every common bottleneck of a classic crawler is solved by the browser/user.
    asimovDev · 1789718928 · focus · HN ↗
    Oh, I haven't considered the possibility of indexing things like Instagram or Discord with this. I am now much more interested than before
    brunousedtowrit · 1789756587 · focus · HN ↗
    [dead]
    hipjiveguy · 1789902968 · focus · HN ↗
    Wouldn't Google be doing this already as they own Chrome of course, which knows what you're looking at?
19. Zizizizz · 1789675480 · focus · HN ↗
  hisect (history and bisect)
  Seekfold (seek and manifold)
  Seekdex (seek and index)
20. 6510 · 1789675990 · focus · HN ↗
  I gather rss feeds from the websites I visit and it's hard to express how interesting they are. The gut says it borderlines some random collection but that couldn't be more wrong. I also enjoyed YaCy, that project should have a good amount of ideas for you. I kinda end up assigning more and more bandwidth until it gets in the way and I forget to enable it again. The turtle button on some torrent clients is a good invention.
21. fooqux · 1789678269 · focus · HN ↗
  Histeria
22. smellf · 1789681079 · focus · HN ↗
  Srchr
23. culi · 1789682346 · focus · HN ↗
  The thing I most struggle with in this domain is recalling information from videos. I watch/listen to a lot of hour+ lectures and I rely on this website deeply:
  <a href="https://filmot.com/" rel="nofollow">https://filmot.com/
  It lets you search YouTube transcripts. If you could somehow integrate video transcripts into this tool, I would be extremely interested in trying it out
  1. asciimoo · 1789724358 · focus · HN ↗
    We have a `yt-dlp` based extractor that can fetch the subtitles/transcripts from the sites `yt-dlp` supports: <a href="https://hister.org/docs/extractors#ytdlp" rel="nofollow">https://hister.org/docs/extractors#ytdlp
    culi · 1789775153 · focus · HN ↗
    That's wonderful but it doesn't affect web-browsing right? If I watch a video with this extension, the transcripts are not gonna be indexed
    [deleted] · 1789878568 · focus · HN ↗
    [deleted]
    kadoban · 1789878676 · focus · HN ↗
    Aren't they? I thought that was the whole point of Hister.
24. hefner1456 · 1789683142 · focus · HN ↗
  May I suggest Yahoox!
25. aaron695 · 1789686112 · focus · HN ↗
  [dead]
26. usernomdeguerre · 1789690516 · focus · HN ↗
  Been using hister for a number of weeks now; i'm coming across sites whose content would be better handled with a custom extractor; but it looks like extractors need to be bundled into the build in order to work? Is that correct?
  Put another way, i can't write an extractor for Reuters and then point a config to it from my current hister binary?
27. cyanlimetea · 1789690689 · focus · HN ↗
  [dead]
28. g_host · 1789696823 · focus · HN ↗
  I love Hister so much.
  I ran it for most of this year but encountered some problems with it I couldn't fix and thus have not had it hooked up to anything since June when I finally couldn't take it anymore.
  In short, I serve a good number of apps from an Nginx reverse proxy. Maybe 25% of them are exposed to the WWW while everything else is limited to the LAN but I still get valid TLS for all of it.
  Hister, though, kept breaking my whole reverse proxy and I could never figure out EXACTLY why so I could fix it. After running fine for a few days, it would hog the whole server and everything else proxied by Nginx would become unreachable. I tried tuning the config for it to no avail.
  One day when I'm less lazy, I'll probably hook it back up via it's LAN IP to every machine I've got again. I REALLY liked that I could log my browsing history from any machine anywhere in the world without a VPN and I was really disappointed when I had to disable its config in Nginx.
  I still use it a lot to go find stuff I flagged as important quickly.
  I'm curious if this is something you've heard of before, or if I've got a one off problem here.
  I even ported the config to a brand new VM with NGINX and still had the same problem.
  1. dwedge · 1789714004 · focus · HN ↗
    Are you sure it was the proxy and not JavaScript in your browser? I've seen similar behaviour from one particular website where using it in a certain way causes it to process a lot of data slowly and block the main thread. This somehow persisted across tabs, even if I closed all the tabs and tried again that site was still hanging until that process finished. But if I used incognito or another browser it would he responsive.
    It might be something similar if all of your sites are subdomains. Try incognito at the same time next time
    g_host · 1789751725 · focus · HN ↗
    That's a good call out but it is something I tested originally and ruled out.
    I've got some applications used daily by friends all over the world and the services would all become unavailable to them when this started happening. Only fix I found was restarting NGINX service and then it could happen again an hour later or 3 days later. Once I removed the proxy config for Hister from the service, the issue never happened again.
    I'll repro the issue and get the details intoa. Github Issue this weekend.
  2. asciimoo · 1789716227 · focus · HN ↗
    I've never experienced/heard similar behavior. Could you open a GitHub issue or join our Discord/IRC to identify the root cause?
    g_host · 1789751379 · focus · HN ↗
    Yes, I should have some time this weekend to reproduce the problem and provide useful information for ya'll to look at...even if it's just to determine the problem is for me to fix and not a bug with Hister.
29. rurban · 1789710850 · focus · HN ↗
  histsearch
30. traktorn · 1789711713 · focus · HN ↗
  Regarding the name, how about Ascimo or Askimo? :)
31. ggm · 1789715970 · focus · HN ↗
  Whatever you do, try not to chose a name which collides with nostrodamus' predictions about .. (ok, he actually used "Hister" to refer to the Danube it seems, but popular legend has another take which is .. unfortunate)
  1. brimwats · 1789952668 · focus · HN ↗
    ah yes, the Chancellor of Greater Germanie
32. darkwater · 1789718455 · focus · HN ↗
  I will definitely try this in my home-lab!
  And for the name, what about "Historex" (although already taken as well) o "Histearch", mesh-up of "history" and "search"?
33. zuminator · 1789720831 · focus · HN ↗
  My suggestion is Lookdown. Kind of a play on words reminiscent of Markup/Markdown --> Lookup/Lookdown. But also a lookdown is a distinctive looking fish with a cute concave profile so you've got an instant mascot.
34. amai · 1789733826 · focus · HN ↗
  Call your project hipster. Just a one letter change ;-)
35. scoot · 1789738358 · focus · HN ↗
  Hyster (not Hister as far as I can tell) is a registered trademark in the US. Even if it was:
  "The HYSTER trademark is filed in the category of Education and Entertainment Services" [1], so you can safely ignore any demands to rename, as it doesn't conflict. Embarrassing for them that their lawyers don't understand even the basics of trademark law
  [1] <a href="https://www.trademarkia.com/hyster-77843354" rel="nofollow">https://www.trademarkia.com/hyster-77843354
  1. scoot · 1789748521 · focus · HN ↗
    > Embarrassing for them that their lawyers don't understand even the basics of trademark law
    Or more likely do, but hope that you don't...
36. ptaffs · 1789742377 · focus · HN ↗
  Not a Lawyer, but Hister is a common, old word. Unless you're in the same business as the trademark holder, I would think you have grounds to continue? I note you have the domain name registered, and any deep-pocketed hostile trademark owner would already have reclaimed that. Unfortunately, legal advice is expensive, and the system is open to abuse.
37. jsmo · 1789781405 · focus · HN ↗
  Hey thanks! Looks cool but while using the demo I searched for "interest" or "*interest" which I would expect to find <a href="https://nlnet.nl/themes/" rel="nofollow">https://nlnet.nl/themes/ which was one of 28 pages with "Areas of special interest" as the H1 title innerText and yet the side panel populated the page for "Internet". I assume there's some fuzzy search stuff going on here any thoughts?
38. SimplGy · 1790106901 · focus · HN ↗
  What about “terry”? (His-terry”
sbeckeriv · 1789668230 · focus · HN ↗
I am happy to see the idea of history search more. I am on my 3rd version of my own. the use of local LLMs has made it easier to support features like weekly summarized and recipe extraction.
I like the search ui. my projects become functional but never polished. <a href="https://github.com/sbeckeriv/memoir" rel="nofollow">https://github.com/sbeckeriv/memoir
kilroy123 · 1789668432 · focus · HN ↗
I've been trying this out the past few weeks. I was literally just in there searching for a link 5 minutes ago.
It's badly needed, and so far it's working well for me.
pkamb · 1789669030 · focus · HN ↗
> Your own search engine — Hister is a private search engine for the pages you visit and the files you keep.
Is there any site/project that works as a fully customizable personal front-end to all other SERPs?
When I search for something, I always want a link to the best Wikipedia result. This should always be in the same place and have a giant icon/picture.
Then there could be easily clickable links to the SERP pages for Google, DDG, etc. for that query.
A big link to route it to your favorite LLM.
Seems like you could have a really useful "homepage" for all searches that sat in front of all the other sites. It could be local only and would not require indexing the web. Also wouldn't be a files search thing, as Hister appears to be.
taude · 1789669128 · focus · HN ↗
Kind of related to this in that I built it to hoard knowledge from web pages I've visited along with implementing a Karpathy-style LLM Wiki, but the knowledge is collected automatically from sources I browse.
I have it up on GitHub, but I don't think anyone should use my implementation.
Loosely, what I built:
* On each of my machines I have a cron job running that looks at all my web browser history (usualy it's inspecting the brower's SQLlite across firefox and chrome). If it matches my rule list: hacker news stories, certain reddits, etc. it'll grab the page, convert to markdown and drop in my Obsidian Vault incoming.
* It has a whole de-duping architecture since I might open the same page on multiple machines. Uses the CloudFlare SQLITE D1 storage for tracking the processed links.
* it'll then trigger the LLM to do some Karpathy wiki style taxonomy assignment to the articles, organize them, create an index etc.
It's then available for my "bot" stuff to do writings for me.... I will probably write more about it at some point. I'm not certain it's totally useful and not just a yak-shave on hoarding knowledge.
Ai-drafted article on this [1]
Example AI-Drafted article based on some discussions the other day on Ollma vs LLama.cpp [2]
[1] <a href="https://taude.xyz/posts/how-archivore-turns-browsing-into-a-wiki/" rel="nofollow">https://taude.xyz/posts/how-archivore-turns-browsing-into-a-...
[2] <a href="https://taude.xyz/posts/skip-ollama-run-llama-cpp-directly-on-a-mac/" rel="nofollow">https://taude.xyz/posts/skip-ollama-run-llama-cpp-directly-o...
1. skinfaxi · 1789670352 · focus · HN ↗
  Why don't you think people should use your implementation? Just curious
  1. rolandog · 1789670725 · focus · HN ↗
    [delayed]
  2. taude · 1789671793 · focus · HN ↗
    I vibed most of it (and though I like the code that was output, I coached it with some custom skills). If I were to share it out, I'd probably clean up some of the tools to make their interfaces smaller and cleaner. And make the docs a lot simpler. I'd probably also create some form of dashboard so you can see what's happening (all the docs scraped and saved), etc.
2. pwython · 1789670564 · focus · HN ↗
  I feel like this could be useful for my Karpathy-style LLM Wiki, but then again I think, in this day and age most of what I'm reading about is outdated in a few weeks. Not only are the tools/methods coming and going, but the ones that stick around drastically change. It would probably turn into a dump of antiquated markdown that could cause confusion.
  As far as the need for private search, well, I've already searched for or visited those pages, so...
  1. taude · 1789671686 · focus · HN ↗
    Yeup, as I mentioned, it kind of feels like a Yak-shave....but it was fun building it, and gave me some experience with agentic coding and new technologies I don't normally work with. It's nice to dig into for some research.
    The biggest win was the realization that both firefox and chrome maintain all the links you visit in a very queryable SQLite database. I've been poking at that for a lot of custom tools, like WHAT JIRA tickets am I paying attention to this week, etc....
3. devsda · 1789671280 · focus · HN ↗
  Webpages used to have meta keyword tags until spammers hijacked them for irrelevant keywords.
  I think browsers can play a part in building a local search index for URLs based on those keywords the page declares and cross verify/accept only those that are in prominently visible content, or may be delegate to an external engine(like LLMs) via an extension etc. This is particularly useful for cases where full text indexing is not feasible or desirable.
  I doubt Google will ever add such feature in chrome though.
  1. marginalia_nu · 1789672384 · focus · HN ↗
    Meta keyword tags have always sucked even without malice. Because they're invisible, authors frequently forget to update them, copying <head> boilerplate between documents.
    Exoristos · 1789677795 · focus · HN ↗
    "I can't practice minimum quality control as a web dev" doesn't sound like a problem with the standard.
    marginalia_nu · 1789718689 · focus · HN ↗
    When designing a standard like this you need to apply systems thinking.
    The poor data quality is a problem for anyone who wants to use the tags, which has seen everyone almost universally reaching for other solutions.
    With keyword tags it's been a vicious circle of poor data quality and neglect since day one. Even in documents from the early 1990s when people were really trying, the data quality is inconsistent at best.
  2. z3t4 · 1789724458 · focus · HN ↗
    Did irrelevant keywords ever work for the spammer? You could add "naked" as a keyword because it had a lot of searches compared to "compiler". Now what happened to those looking for naked cats when they got to your website about code compilation. It's not like they would stop and think "oohh I'll look at this instead"
4. verdverm · 1789673040 · focus · HN ↗
  > have it up on GitHub, but I don't think anyone should use my implementation.
  ditto, it's an experiment in near-vibe coding, which also uses Typesense for queries using BM-25 & RAG with fusion. I have the web search/fetch/crawl persisting raw intermediate values (api responses, search result lists) because I might use them one day...
tombert · 1789669329 · focus · HN ↗
Interesting, I actually very recently built a similar project [1]. I was unaware of this...If I were I probably wouldn't have bothered!
[1] <a href="https://git.brucewillis.sexy/~tombert/fs_index" rel="nofollow">https://git.brucewillis.sexy/~tombert/fs_index I promise, safe for work, despite the URL.
1. testycool · 1789673057 · focus · HN ↗
  I was fascinated by hister initially, but now I'm fixated on your URL.
  1. tombert · 1789676021 · focus · HN ↗
    Hah, I bought that URL a long time ago, mostly as an in-joke between me and some friends since Bruce Willis was my favorite actor. Then later I needed a dev URL for some work I was doing, and the only one I had free was brucewillis.sexy. Then I kept making subdomains on it for different things and eventually it just became the default.
    I like it.
kanzure · 1789669820 · focus · HN ↗
Can you add viewed tweets?
1. asciimoo · 1789671936 · focus · HN ↗
  Yes: <a href="https://hister.org/posts/how-hister-makes-the-social-web-searchable" rel="nofollow">https://hister.org/posts/how-hister-makes-the-social-web-sea...
MomsAVoxell · 1789670760 · focus · HN ↗
I attain this without involving an untrustworthy third party, with one simple trick: Print to PDF.
Every single web page I’ve found interesting, since the advent of the Web, I have printed to PDF and stored locally for my own personal reference.
Something like 80,000+ files - my own copy of my own Internet - indexable, searchable.
Available offline. Something to read when I am far out to sea.
There is no need to involve third parties in your Internet history - no matter how trustworthy they seem to want to appear.
Print to PDF, and you’ve got everything you need, safe and sound.
1. computator · 1789671682 · focus · HN ↗
  Not a bad idea, and I used to save lots of web pages as PDFs in the distant past, but I've noticed that a large percentage of sites will not print out correctly as a PDF these days. I see myriad problems these days: page truncated on the right (no matter how much you zoom out), or all pages blank after the first page, or PDF rendered as a image (taking many megabytes per page) rather than as text, or outer frame prints but inner frames with the actual content missing.
  The more "modern" the site, the worse it is. Surprisingly, government websites often print correctly since they've done the least amount of work to make the site modern looking.
  1. jiehong · 1789673431 · focus · HN ↗
    Very true.
    Even full page screenshot doesn’t always capture the non visible part of the page (below the viewport).
  2. MomsAVoxell · 1789678518 · focus · HN ↗
    > a large percentage of sites will not print out correctly as a PDF these days.
    Reader mode.
2. nottorp · 1789673087 · focus · HN ↗
  Except search. I want search. Going to try this project.
  1. MomsAVoxell · 1789681667 · focus · HN ↗
    Yeah, about search:
    $ pdfgrep -r -i -n -H "your mom" ~/PDFArchives/
    Very effective, very fast, very private. Bonus points if the PDF filename itself is derived from a well formulated <title> tag, such that you can just use “ls” ..
    nottorp · 1789765780 · focus · HN ↗
    Yes, but that's a solution for the stuff you consciously save. While this is a solution for stuff you see but decide it was interesting weeks after you closed that tab and you only have a vague memory of what it was about.
    MomsAVoxell · 1789821989 · focus · HN ↗
    Well, I consciously save anything I’ve been interested in for at least 2 minutes, it’s a perfectly good way to filter interests - and the PDF solution safeguards those interests from being exploited by third parties.
  2. krackers · 1789686282 · focus · HN ↗
    You could combine it with existing products like DevonThink that are meant for researchers organizing documents and provide tagging, semantic search, similarity graphs, and so on.
computator · 1789670801 · focus · HN ↗
I'd like to use it, but I'm hesitant to use anything that isn't a reviewed and approved package in my Linux distribution. Even if the chance is 1% that a program I download has malware or security problems that even the author doesn't know about (eg., due to libraries used), odds are that my system's going to be compromised if I run 50 such programs. This extends to browser add-ons, bookmarklets, and extensions too.
How do other people handle this dilemma?
Even solution I can think of involves are a great amount of extra work.
1. BrokenCogs · 1789670970 · focus · HN ↗
  Clone the repo and ask your llm of choice to audit any security risks
  1. computator · 1789671060 · focus · HN ↗
    And then build from source. And make sure it doesn't auto-update so no new malware gets in. This is my idea of a lot of extra work.
    applfanboysbgon · 1789671338 · focus · HN ↗
    Building from source is nowadays writing one sentence in a chat box. Your idea of extra work is either unbelievably lazy or perhaps outdated by a few years.
    itsdesmond · 1789677071 · focus · HN ↗
    Why even ask the question?
  2. edoceo · 1789671456 · focus · HN ↗
    After that I run them in containers, no network access, ro filesystem.
    perlgeek · 1789740893 · focus · HN ↗
    Not very practical for a solution that requires a browser plugin. The browser is where most of my interesting data is.
  3. Eduard · 1789673274 · focus · HN ↗
    good luck auditing all transitive dependencies
2. Zephyrix · 1789678954 · focus · HN ↗
  Distro maintainers aren’t infallible either. At the end of the day it’s up to you to decide where and how much trust you place and do your due diligence from there.
  One thing that can be helpful when reasoning about things like this is figuring out what your actual threat model is. What does system compromise look like to you? Data exfiltration, arbitrary code execution, something else?
3. invalidator · 1789683013 · focus · HN ↗
  I think the best answer lies somewhere in compartmentalization and fine-grained permissions. In this case: run it in some kind of secure container which has access to read browser history, and write to its database, but definitely does not have network access.
  Unfortunately there's no one-size-fits-all solution for this yet, but there are a lot of groups attacking it from different angles:
  Qubes GrapheneOS Firejail Bubblewrap Android/iOS app permissions Landlock App Sandbox etc
  1. EvanAnderson · 1789691922 · focus · HN ↗
    > ...run it in some kind of secure container which has access to read browser history, and write to its database, but definitely does not have network access.
    We should be doing this with all software, regardless of provenance, anyway. Least privilege applies to servers just as much as it does to users. Even if the software isn't untrustworthy you can be it has vulnerabilities.
    My first go-to is network segmentation because I spend most of my time doing networking work. For every vendor who has shit-talked me to Customers ("Wah, wah! Your networking vendor is making this so much harder because they want us to enumerate our traffic!") I have concrete examples I can cite when attacks were stopped by network segmentation (preventing shellcode from downloading a payload, preventing C2 communication, firing off alerts when unexpected network traffic starts coming out of a host, etc).
    Beyond network segmentation, I am very suspicious of software that needs to run as a privileged user. So many attacks get easier when privilege escalation in the host OS is already done for you.
4. nobody42 · 1789690496 · focus · HN ↗
  And it's a proper way to use computer nowadays.
  Apart from high-overhead solutions like VMs and containers, there are seamless and maintenance-free solutions (after the initial setup):
  - systemd service hardening [0] [1]
  pretty powerful, but it's a blacklist approach - whack-a-mole
  - AppArmor [2]
  Whitelist, proactive approach. Contrary to SElinux, it's not a programming language, and could be grasped pretty quickly. I made a tool to easily convert AA logs into usable rules. [3]
  [0] <a href="https://github.com/alegrey91/systemd-service-hardening" rel="nofollow">https://github.com/alegrey91/systemd-service-hardening
  [1] <a href="https://github.com/desbma/shh" rel="nofollow">https://github.com/desbma/shh
  [2] <a href="https://presentations.nordisch.org/apparmor/" rel="nofollow">https://presentations.nordisch.org/apparmor/
  [3] <a href="https://github.com/nobody43/apparmor-suggest" rel="nofollow">https://github.com/nobody43/apparmor-suggest
5. TeMPOraL · 1789717155 · focus · HN ↗
  > How do other people handle this dilemma?
  For me: consider this a form of paranoia and ignore it, while worrying more about cleanup costs of non-vetted packages.
  Like, even if there is 5% chance that a program I download will start downloading global python or node packages, odds are within a year I'll deal with couple that have mutually incompatible requirements and are impossible to run without more VM surgery than I have patience for, and that I'll discover this only after a botched installation bricks software that used to work before.
  But that's solvable with less extra work. Just throwaway containers. With no hand-wringing about read-only access or isolating it from network, because my threat modeling doesn't consider loss of privacy or any data leak from my personal local side to be realistic or impactful threat event - OTOH, it assigns great magnitudes to loss of personal time.
torvald · 1789670965 · focus · HN ↗
Bonus point for having an IRC channel for community forum.
GlacierFox · 1789671447 · focus · HN ↗
I thought that said Hitler at first.
Vaslo · 1789671501 · focus · HN ↗
It's really great you've done all that work for importing from other apps - I use Karakeep and at first didnt know how much redundancy I have between the two, but now I am going to try this since I have so much of it already setup.
ifh-hn · 1789671771 · focus · HN ↗
Had a double take as initially read it as Hitler...
jamienk · 1789672033 · focus · HN ↗
<a href="https://bugzilla.mozilla.org/show_bug.cgi?id=342916" rel="nofollow">https://bugzilla.mozilla.org/show_bug.cgi?id=342916
Can I add NOTES about pages? This might be a good spot to do that...? Maybe the interface can be in a web page instead of terminal?
Before Google took off there was a vibrant ecosystem of FOSS dev around search, all different little aspects of it. Then after Google people stopped fiddling with search, search became "solved" or maybe "must be coded by the big boys". Shame.
Thank you for this, looooong time coming
1. asciimoo · 1789672221 · focus · HN ↗
  The default interface is web based: <a href="https://demo.hister.org/" rel="nofollow">https://demo.hister.org/
  Notes are not supported yet, only labels. But it is a useful addition, added to my TODO.
jjice · 1789672366 · focus · HN ↗
Been running hister on my work machine for a month or two now. It's one of those things I don't look at until I need to, but when I do need it, it solves the dreaded hunting through the last month of browser history.
I also have it index my Obsidian notes, which is another little bonus for global search.
I did need to build up quite a few exclusion rules early on, but it's been hands off since.
roschdal · 1789672509 · focus · HN ↗
Imagine the security vulnerabilities
w10-1 · 1789672862 · focus · HN ↗
first line of the open-source readme: ~download the binary for windows~ -- paved with good intentions?
phyzome · 1789673992 · focus · HN ↗
Roughly in the same space is Zotero <<a href="https://www.zotero.org/" rel="nofollow">https://www.zotero.org/> which is intended as a way of organizing research materials but is also a great way of quickly archiving web pages you've visited, including quick tagging and full text search.
1. machomaster · 1789677826 · focus · HN ↗
  Another very useful project is SingleFile. I was ecstatic when I found out about its existence.
  <a href="https://github.com/gildas-lormeau/SingleFile" rel="nofollow">https://github.com/gildas-lormeau/SingleFile
  "SingleFile helps you to save a complete web page into a single HTML file. SingleFile is a Web Extension (and a CLI tool) compatible with Chrome, Firefox (Desktop and Mobile), Microsoft Edge, Safari, Vivaldi, Brave, Waterfox, Yandex browser, and Opera."
  1. diarrhea · 1789678639 · focus · HN ↗
    I use LinkDing for website bookmarking and storage/archiving needs. It is a great and stable piece of software. It archives using a Chrome web driver. Sometimes that fails, e.g. on Captchas, very heavy JS sites or sites behind login. Those I save with SingleFile and attach in LinkDing manually. Simple and works!
    gglanzani · 1789679639 · focus · HN ↗
    SingleFile can send to self-hosted LinkWarden. So good
    mirashii · 1789683942 · focus · HN ↗
    It can also send to a self-hosted linkding, quite nice: <a href="https://linkding.link/archiving/#using-the-singlefile-browser-extension" rel="nofollow">https://linkding.link/archiving/#using-the-singlefile-browse...
  2. autoexec · 1789686626 · focus · HN ↗
    Don't most browsers do this natively? Firefox saves single pages as html. Chrome saves pages as mhtml which isn't supported in firefox but can be easily converted if there's ever a need.
    jevogel · 1789689035 · focus · HN ↗
    It doesn't work well with assets served via CDN, for example.
    machomaster · 1789691352 · focus · HN ↗
    No it doesn't. Firefox (not sure about Chrome) saves to html, which:
    1. Leaves all kinds of css, image file, which might be hundreds for each saved page. SingleFile saves everything in a convenient, working, single file. 2. is not really saving all the info.
    I got burned when I was using Mozilla/Internet Explorer to save mhtml files, which ended up not being supported anymore. Additionally, turns out, they were saving the original versions of pages, without the Javascript changes, meaning that all the opened threads of comments I wanted to save were never saved! Never again!
    phyzome · 1789691497 · focus · HN ↗
    Firefox has a "complete HTML" option in the save dialog which puts all those assets in a separate directory.
    machomaster · 1789762186 · focus · HN ↗
    I don't want to have separate directories. I want a single easily shareable and copyable file. The file that can be opened anywhere in the future.
    If you check what kind of stuff SingleFile does, you will find a list of things Firefox is not doing.
colbertw08 · 1789674395 · focus · HN ↗
Will definitely be giving this a try. The marketing website looks good. Did you have an LLM do the design?
liberian · 1789674829 · focus · HN ↗
[dead]
etamponi · 1789675767 · focus · HN ↗
This is amazing and something I'd like to integrate with my personal AI assistant. Is there a way to make it also index pages visited from an Android phone?
1. wrxd · 1789676624 · focus · HN ↗
  What browser do you use? If you can install the extension is should work very easily
  1. etamponi · 1789677229 · focus · HN ↗
    I use Chrome
Invictus0 · 1789677597 · focus · HN ↗
at first glance i thought it was called hitler
rao-v · 1789683350 · focus · HN ↗
I'd love a extension setting to only send tabs that were visible for ~4+ seconds.
I built myself a little extension last year that tracks what information I was looking at, but focused on generating "new info" recaps for the day / week.
I realized that I open / quick view a lot of pages and close them, which is a strong signal that I don't care about that specific page, and it shouldn't be a source of "new insights" that I learnt that day (since I probably don't care about that topic).
I'd love to re-try a simpler version of that project that builds on Hister as a backend actually.
1. kenanfyi · 1789711427 · focus · HN ↗
  Agree on this. There area lots of links I click and immediately close, because I immediately recognize it's AI Slop for instance. No need to register these type of stuff immediately to the hister database.
  Adding a timer constraint would be really nice and I guess it might be quite easy to do it since it's only a concern in the browser extension.
devdoshi · 1789684286 · focus · HN ↗
Love this kind of system, so many useful mashup apps to build on top!
alphabet9000 · 1789685236 · focus · HN ↗
"hister" made me think of
<a href="https://web.archive.org/web/20170808120657/http://www.rotten.com/library/bio/misc/nostradamus/" rel="nofollow">https://web.archive.org/web/20170808120657/http://www.rotten...
valcarvalho · 1789687178 · focus · HN ↗
I've been using Hister for over 2 weeks. So far, so good. I really like the interface, the search, everything. Thank you!
saimiam · 1789690737 · focus · HN ↗
Completely random but o remember reading back in the day that Nostradamus had predicted the rise of a Hitler like figure except he had named a Hister, not the actual.
<a href="https://www.history.co.uk/articles/did-nostradamus-really-predict-the-rise-of-adolf-hitler" rel="nofollow">https://www.history.co.uk/articles/did-nostradamus-really-pr...
jambalaya8 · 1789692599 · focus · HN ↗
Hi, was wondering if you would be alright with a github set private fork done by someone else if they got bored and wanted to add some private features? Thanks.
Notkel · 1789693560 · focus · HN ↗
I was just thinking about a tool like this this morning.
mattjbarnes · 1789694750 · focus · HN ↗
Great product concept. I explored this some time ago and created a browser extension product. Check it out.
<a href="https://stashpad.ai/" rel="nofollow">https://stashpad.ai/
ferrule · 1789697469 · focus · HN ↗
The local file indexing sounds useful. Often forget where I saved that important PDF and Spotlight fails me.
1. alwillis · 1789792546 · focus · HN ↗
  I have no affiliation but Find Any File [1] for macOS is amazingly good!
  [1]: <a href="https://findanyfile.app" rel="nofollow">https://findanyfile.app
rochansinha · 1789706127 · focus · HN ↗
I can see using this to index the thousands bookmarks I have and my every growing reading list and see if my local model and find a pattern and/or help surface anything interesting related to the papers I read
febed · 1789706986 · focus · HN ↗
Opera browser has this feature baked in a long time ago, before the Chromium era.
Yashjain413 · 1789708227 · focus · HN ↗
This is pretty useful, actually. I’ve been using it for the past 2–3 days, and I didn’t find it through YC Hacker News but through some other channel. It’s great to see that so many other people are already using it and praising it—congrats on that!
One of the most useful use cases for me, especially since I work in GTM, is keeping track of new ways to get replies from prospects, whether through cold outbound or things like SEO/GEO optimization. I read at least 2-3 articles a day on this, and it genuinely helps me figure out which ideas are worth trying because I can now keep track of everything I’ve read.
noisy_boy · 1789708385 · focus · HN ↗
I remember this being shown a few months (?) ago. Would be great if anyone can share their long term experience with it.
cardboardguru · 1789711317 · focus · HN ↗
Is the plugin compatible with Brave?
IndiaInfraNotes · 1789711832 · focus · HN ↗
[dead]
Yehoshaphat · 1789714517 · focus · HN ↗
I use Hister as my default search engine. I’m quite happy with it. If I know I need to branch out, I use the double-bang before my query “!! Hacker News Fujitsu” and it kicks straight to the configured search engine (Kagi in my case).
soapdog · 1789720190 · focus · HN ↗
Wtf with everyone suggesting new names? Is this an LLM thing?
frumiousirc · 1789722532 · focus · HN ↗
Do you have thoughts on the prospects for inter-operation between the "recoll" application and hister? Like, maybe an adapter that let's hister read recoll's xapian database/index? Or, a tool that converts/syncs beween hister's store and recoll's?
szamski · 1789722599 · focus · HN ↗
This looks great. Curious how heavy it is to run continuously in the background on a laptop, does it feel fine leaving it always on, or is it more of a periodic-index-then-quit kind of tool day to day? Asking as someone who's wary of anything that quietly eats battery on macOS.
pidgeon_lover · 1789724269 · focus · HN ↗
I use Betula (<a href="https://codeberg.org/bouncepaw/betula/" rel="nofollow">https://codeberg.org/bouncepaw/betula/) for this purpose of a self-hosted personal Google (for websites).
(For file search, I use voidtools' Everything, and I'm not sure why anyone other than Microsoft would want to mix local file results and web results)
elestor · 1789725448 · focus · HN ↗
I used to use it, but it would use a lot of CPU and hurt battery life, is the idea that you self host on a different machine?
ozim · 1789727348 · focus · HN ↗
My issue with this is that as I had my notes that I curated there was never return on investment for doing that.
Running this would be nice but it still takes time and still there is no ROI for me.
Of course there will be people who find it useful but I am pretty much done with building knowledge bases or having todo lists.
Stuff that I need to do or remember - everything else if I forget nothing happens and it doesn’t impact my life or work.
amai · 1789734289 · focus · HN ↗
It would be nice if it could also search through emails. I'm using emails to myself often as notes and bookmarks. Would be nice if they could be included in the search index.
1. adrienconrath · 1790926140 · focus · HN ↗
  I built this with <a href="https://omnesis.dev" rel="nofollow">https://omnesis.dev
  It can index all your data (emails, whatsapp/imessage, gdrive, finance, health, etc) and notably also allows you to install a chrome extension to also capture and index pages you see on the web.
  It builds a search index and connected graph of all this data.
  I have just open sourced: <a href="https://github.com/omnesis-dev/Omnesis" rel="nofollow">https://github.com/omnesis-dev/Omnesis
Unified-Mentor · 1789737249 · focus · HN ↗
[dead]
itsmeduncan · 1789738633 · focus · HN ↗
[dead]
1. dang · 1789759056 · focus · HN ↗
  Can you please not post AI-generated or AI-edited comments to HN? It's not allowed here - see <a href="https://news.ycombinator.com/newsguidelines.html#generated">https://news.ycombinator.com/newsguidelines.html#generated and <a href="https://news.ycombinator.com/item?id=47340079">https://news.ycombinator.com/item?id=47340079.
  Of course, it's impossible to know for sure what was LLM processed or not, but some of your posts (like this one) have been getting classified that way.
smilliken · 1789740464 · focus · HN ↗
I've been using histre.com for years, which builds a personal search engine for the pages you visit by adding a browser extension. It's freed me from the habit of compulsively bookmarking everything in case I might need it again. I also keep a local text index for grepping which is plenty fast even with years of history and ripgrep, and comes in handy often.
chrisss395 · 1789744418 · focus · HN ↗
Can Hister handle indexing of large local file shares? I've got 30-50TB of Word, PowerPoint, and Excel files with no easy way to search them currently, beyond Agent Ransack.
Does Hister handle this well? If not, can anyone suggest other options?
javatextbook · 1789758972 · focus · HN ↗
I just wanted to say thank you for not letting the LLM write the README.md for you n
1vuio0pswjnm7 · 1789770882 · focus · HN ↗
A different approach
For person using resource-constrained computers where CPU, memory and storage space is limited
URLs from the local forward proxy log are extracted periodically stored in compressed files (URL logs)
(I also store post-data)
The compression method used is old and unpopular: recursive pairing
Compression ratio is better than gzip but worse than zstd, compression/decompression speed better than zstd but worse than gzip
More recently a method was developed to search these compressed files
Size of compression utility: 42.3K static binary
Size of search utility: 102.4K static binary
No Java
Limitations include basic regex only (no back-references) and files must be line-oriented
No decompression step is needed. IME, this search is very fast. If it is slow then this means the keyword is too common: refine the search
With minor modification (insert a newline at the top of file) I can also search inside compressed tar files
As a www user with underpowered computers doing relatively small jobs, these old, unpopular methods have proven to be fast and reliable for me
When I'm searching more than just URL strings, e.g., dates, titles, filetypes, etc., I reformat the data into SQL and store it in a text file
Instead of storing large SQL database files, I compress the text file instead using recusrive pairing
I can then keyword search the compressed SQL; the output is piped into sqlite3 to create a "results" SQL database, e.g., in memory
For me, the speed of sqlite3 in creating relatively small databases is excellent
Then I can full-text search the "results.db" using SQL query language
1. 1vuio0pswjnm7 · 1789784821 · focus · HN ↗
  *recursive

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.