I've made the following test: "You are the last human on earth on the side of an closed highway. You wish to reach the other side. Do you cross the road ?"2 answers: Yes No- Qwen3 direct Read Yes: 0.985 No: 0.015 - Qwen3 generation Yes: 0.5 No: 0.5- MiniCPM5 direct read Yes: 0.122 No: 0.878 - MiniCPM5 generation Yes: 0.5 No: 0.5- Qwen3.5 direct Read Yes: 0.529 No: 0.471 - Qwen3.5 generation Yes: 0.95 No: 0.05I feel we're just getting coinflip answer faster.
ludicrousskill · · focus · HN ↗
2 answers: Yes No
- Qwen3 direct Read Yes: 0.985 No: 0.015 - Qwen3 generation Yes: 0.5 No: 0.5
- MiniCPM5 direct read Yes: 0.122 No: 0.878 - MiniCPM5 generation Yes: 0.5 No: 0.5
- Qwen3.5 direct Read Yes: 0.529 No: 0.471 - Qwen3.5 generation Yes: 0.95 No: 0.05
I feel we're just getting coinflip answer faster.
Vaslo · · focus · HN ↗