> I ran the agent 100 times. In 88% of the tests, it didn't open the external website. It either hallucinated a discount code or simply ignored the instructions.
Bad model? Don’t think I’ve ever seen a model ignore a link in instructions. It always wants to see what’s there
Havoc · · focus · HN ↗
Bad model? Don’t think I’ve ever seen a model ignore a link in instructions. It always wants to see what’s there