Thread

1. nico · 1790006937 · focus · HN ↗

   If you only need classification, and you can provide some training data, you can ask Codex/Claude to build an embeddings + logistic classifier model for you

   For emails, I get 95% accuracy with this method, with only 50-100 examples for training

   Training the model takes less than 5 minutes on a CPU

   The resulting model is <1MB, and inference is sub 100ms

   Some other cool things about this approach:

   * the model doesn’t train on some “ideal” or general classification, instead it learns your preferences

   * the model runs on pretty much any mobile device and can be retrained online on the device

   * privacy, the whole training and inference is 100% local, no data goes anywhere (except whatever you feed codex/claude while building the model)

   Note: to do a more general test, I made a classifier for the Banking77 dataset. The model is <10MB, trains in <30s on CPU and gets 94.5% accuracy, which puts it in the top 5?models by accuracy for that set (the best one is at 94.86%, but it’s 350MB in size and takes hours to train on a GPU).

   1. psadri · 1790046742 · focus · HN ↗

      Now that the models are smarter / know more than most of us, a new bottleneck is finding out what you don't know. If you don't know about logistic classifiers and how they could be applied to your problem, you will not ask for it.

      These days, I tend to start my coding sessions by the high level problem I'm trying to solve vs the prescriptive, specific solution I may have in mind. It often surfaces ideas and approaches that I did not know about.

      1. dotancohen · 1790469264 · focus · HN ↗

           > It often surfaces ideas and approaches that I did not know about.
         

         I'd love to hear some examples. I do agree that tech is moving at a pace that I can no longer keep up, however that absolutely does not mean that I want a dependency on some project that didn't even exist this time last year.

Unofficial Hacker News client; not affiliated with Y Combinator.