‹ BackHN Continuity

Thread

Show HN: AI search for every photo and every frame of video on macOS

153 points · 69 comments · allenleee

  1. postalcoder · · focus · HN ↗
    Since this is for the mac you really should be using apple's vision framework for OCR. It smokes tesseract in both speed and accuracy.

    Edit: I'm curious which LLM was used to generate the code. I fed the title of your post to claude/deepseek/qwen/codex asking to recommend a stack for this project, expecting to frown thinking that they still recommend tesseract. However, I found that they all recommend apple's vision framework. In fact the latest model to recommend Tesseract is gpt-4.1.

    1. nullsanity · · focus · HN ↗
      And this is why vibe coders always make inferior software.
      1. fhub · · focus · HN ↗
        Compared to who? Every professional developer? Someone learning to code? Fabrice Bellard?
    2. daveguy · · focus · HN ↗
      nullsanity got downvoted into oblivion, but they are correct. This is one of the many reasons why vibe coding produces worse software. The code that is generated and the best practice recommendations are completely separate. They both come from a distribution of "most common", and best practice is rarely common. Especially when a practice is first established, or in a specific niche.
      1. spiderfarmer · · focus · HN ↗
        On the flipside, it also leads to better software.
      2. thih9 · · focus · HN ↗
        Unless you are referencing some existing non vibe coded app, complaints the project being vibe coded may be just too generic at this point.

        A hand coded electron project would have a discussion about electron vs native. Relevant in general but off topic in the context of this particular app.

      3. xp84 · · focus · HN ↗
        Isn’t that why you use a plan mode? Or better, use a plan mode, revise and critique the plan, and then let it proceed to build?
      4. baxtr · · focus · HN ↗
        Maybe the real question is: who cares?

        What’s the downside risk of having "worse software" when you’re just ideating and putting things out there to see how people like it.

        1. Someone · · focus · HN ↗
          Your idea can be great, but if the implementing is bad, people still may not like it, and you’ll never know that’s the cause.
          1. daveguy · · focus · HN ↗
            And manager types in software still haven't figured out that prototypes should not be the final product. In engineering it's common knowledge and only rarely do you take a proof of concept directly to production.
          2. TeMPOraL · · focus · HN ↗
            Worst case:

            - release vibe coded tool

            - on HN, someone says, d'oh, you should be using Y, not X

            - give that comment to your LLM

            - LLM: "The commenter on Hacker News is absolutely right, my mistake. I can easily replace X with Y if you want"

            - release a new, better version of vibe coded tool

            Iteration, in one afternoon.

      5. losteric · · focus · HN ↗
        idk about that. The big labs and their data providers are spending millions of dollars building up expert datasets. I was offered $120/hr to critique outputs and provide my own designs. Thats clean and high quality data, not the average internet word distribution
      6. WokeUp420 · · focus · HN ↗
        Kind of like "history is written by the victors"
    3. spiderfarmer · · focus · HN ↗
      So the prompt was probably something like: build me x using Tesseract.
    4. robotmay · · focus · HN ↗
      Mostly unrelated but fun thing I discovered earlier this year with Apple's vision - if you have text both correctly oriented and upside down in the same image, it likes to interpret the upside down text as a Cyrillic alphabet. I was trying to use it to read the text on camera lenses and it came up with all sorts of bizarre interpretations. If anyone's interested, I got around it by splitting the text at a point and unrolling it into a straight line before running OCR on it.
    5. vavkamil · · focus · HN ↗
      I recently tried to recover text from 8 frames of an office-shot YouTube video, where only a small, blurry portion of a computer screen was visible. After spending half a day with Astra on it, the conclusion was that it’s not possible to read.

      Later that evening, I just paused the YouTube video on my phone, circled the part of the display with Google Lens, and it read the whole thing with pretty good accuracy. It was mindblowing :)

      1. sheept · · focus · HN ↗
        All those years of captchas must've made Google's model bulletproof
    6. allenleee · · focus · HN ↗
      Hey author here! :) Great point.

      You're totally right. Apple Vision is generally way faster and more accurate on Apple Silicon. Pure Mac-only, I'd use it. (also smaller)

      Main reason I went Tesseract: I want SCM to stay portable easily. It's ARM Mac for now, but the inference layer is all JS end-to-end — Transformers.js + ONNX for CLIP/SigLIP + Whisper, Tesseract.js WASM for OCR, all in plain Node workers.

      A bit of background: I'm actually an iOS/macOS dev and I really love SwiftUI and AppKit — I just wanted v1 to stay portable by construction. Exploring a native Swift + MLX v2 track separately for speed.

      1. novok · · focus · HN ↗
        If you look at the apple photos db you'll see that there is a bunch of cached pre-analysis you can leverage for items in apple photos.
        1. allenleee · · focus · HN ↗
          thanks for this! will do some research on it
    7. darepublic · · focus · HN ↗
      My own experiments with tesseract were very mixed. I did use just a locally runnable version from a public repository. Text from webpages. Sometimes it would do great but small variations could make it fail completely. Paddleocr on single line text for me has accuracy in the range of 95%
    8. WokeUp420 · · focus · HN ↗
      Turns out it's possible to build something without a glorified next-character search engine afterall
    9. schainks · · focus · HN ↗
      This. Learn all the knobs and dials, too. Useful performance gains to be made by tuning the right settings.
    10. amelius · · focus · HN ↗
      I mean, anything built in the AI age will smoke Tesseract.

      It is a tool from a bygone era.

    11. eecks · · focus · HN ↗
      Such a strange edit comment. How about the author just picking the stack himself..
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.