IMO by asking Jev underspecified questions like this, you're essentially using it as a random number generator (similar to the dice example). On actual NLP problems (including ones with uncertainty under human review) it does appear to be well calibrated: <a href="https://leonardgrazian.com/blog/jev-calibration/" rel="nofollow">https://leonardgrazian.com/blog/jev-calibration/
cannedbread · · focus · HN ↗
gxcsoccer · · focus · HN ↗
[dead]