‹ BackHN Continuity

Thread

Heretic removes restrictions from language models

279 points · 111 comments · Bluestein

  1. N_Lens · · focus · HN ↗
    Looks like a well engineered, automated abliteration pipeline. The claims seem a bit overstated though, since the metrics mentioned are cherrypicking refusal count and KL divergence, both of which make the outcome seem the most dramatic.
    1. tacomagick · · focus · HN ↗
      I personally never saw much of a quality drop from models put through Heretic if that amounts to anything. They have been working quite well on small local models so far.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.