>We trained Kolibri with abstention data and with our Merlin-Arthur protocol. As a result, it is trained to say "I don't know" when the answer isn't in the context.
(for context, the Minecraft Support chatbot, aka Merl, had a meme because she kept saying "I don't know" to questions like "How to craft a diamond pickaxe".
andai · · focus · HN ↗
<a href="https://aleph-alpha.com/en/blog/bounding-hallucinations-merlin-arthur-protocols-for-mutual-information-bounds-in-language-models/" rel="nofollow">https://aleph-alpha.com/en/blog/bounding-hallucinations-merl...
Velocifyer · · focus · HN ↗
<a href="https://minecraft.wiki/w/Minecraft_Support_Virtual_Agent#System_Quotes" rel="nofollow">https://minecraft.wiki/w/Minecraft_Support_Virtual_Agent#Sys...
(for context, the Minecraft Support chatbot, aka Merl, had a meme because she kept saying "I don't know" to questions like "How to craft a diamond pickaxe".
joquarky · · focus · HN ↗