Thread

Show HN: JevBench, a reproducible benchmark for typed decision models

154 points · 39 comments · florianstandhar

nzoschke · 1790113497 · focus · HN ↗
<a href="https://is-it-ai-slop.app.mintapis.com/" rel="nofollow">https://is-it-ai-slop.app.mintapis.com/ is a fun tool. Is the source or methodology for that in the github repo? I couldn't find it immediately.
We've been experimenting with Jev for classifying email, some thoughts here: <a href="https://housecat.com/blog/classifying-email" rel="nofollow">https://housecat.com/blog/classifying-email
Flagging AI written email is a much requested feature too.
1. ajs1998 · 1790123287 · focus · HN ↗
  I asked free chatgpt to give me some essays that will fool a slop detector and they all fooled this slop detector. Its best guess was "6% slop probability 87% confidence answered in 0.5 s for $0.000027" and yet it was 100% slop.
  I am very skeptical slop detectors will ever work.

Unofficial Hacker News client; not affiliated with Y Combinator.