Thread

1. [deleted] · 1785973926 · focus · HN ↗

   [deleted]

2. maxsich · 1785974002 · focus · HN ↗

   [dead]

3. rafaepta · 1785974430 · focus · HN ↗

   measuring humor might be halfway to measuring taste. congrats on this... really original contribution. wonder if you're planning to evolve the benchmark to incorporate a multi-language dimension. would love to see how Mistral and models built outside the US would perform.

   1. killiandunne1 · 1785974758 · focus · HN ↗

      Nice a good way to 10x inference costs... worth seeing though ahaha
4. dlcarrier · 1785975790 · focus · HN ↗

   Can you also measure how often the LLM response makes people laugh? Sometimes the responses that aren't attempting a joke are the funniest, and I'd be more interested in stats of which LLM succeed in that metric.

   1. killiandunne1 · 1785977297 · focus · HN ↗

      Interesting point - thoughts on how to do this? Honestly most models are not-to-kinda funny so I'd be surprised if there were many lol moments. Oral delivery is something I think is v interesting though

      1. dlcarrier · 1786045861 · focus · HN ↗

         You'll probably still get plenty of smirks, smiles, and silent chuckles. OpenCV or a similar machine vision system should be able to pick those out from a webcam aimed at a reviewer.
5. [deleted] · 1785981950 · focus · HN ↗

   [deleted]

6. maxzhdev · 1785990732 · focus · HN ↗

   I can’t imagine how to correctly assess the ability to humor, because this is a very subjective and relative phenomenon. The work ahead is serious

   1. killiandunne1 · 1786038815 · focus · HN ↗

      We don't wanna be too serious ;)

Unofficial Hacker News client; not affiliated with Y Combinator.