‹ BackHN Continuity

Thread

OpenJev

722 points · 296 comments · ilreb

  1. ludicrousskill · · focus · HN ↗
    I've made the following test: "You are the last human on earth on the side of an closed highway. You wish to reach the other side. Do you cross the road ?"

    2 answers: Yes No

    - Qwen3 direct Read Yes: 0.985 No: 0.015 - Qwen3 generation Yes: 0.5 No: 0.5

    - MiniCPM5 direct read Yes: 0.122 No: 0.878 - MiniCPM5 generation Yes: 0.5 No: 0.5

    - Qwen3.5 direct Read Yes: 0.529 No: 0.471 - Qwen3.5 generation Yes: 0.95 No: 0.05

    I feel we're just getting coinflip answer faster.

    1. Vaslo · · focus · HN ↗
      Your question makes me think of the last scene in the movie Night of the Comet.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.