Thread

1. msejas · 1790752078 · focus · HN ↗

   As a claude code power user, when I get the 'rate the feedback on Claude' pop up, I used to say good or fine out of habit, and immediately after sending this feedback, I felt an instant degradation and mistakes that usually don't happen.

   Now I dismiss it every time and the quality is more consistent.

   Complete adhoc and personal experience but something I've observed, wouldn't be surprised if they nerfed on a per session basis

   1. Aurornis · 1790773974 · focus · HN ↗

      As a counterexample, I click that feedback all the time and nothing ever changes afterward.

      1. SilverSlash · 1790774545 · focus · HN ↗

         My personal issue with clicking the feedback is that I'm doing free RLHF for Anthropic without getting anything in return.

         1. Aurornis · 1790774701 · focus · HN ↗

            You’re probably participating in 100 or more A/B tests per year without knowing it and getting nothing in return other than a minor contribution to the company’s internal knowledge about what customers like.

            1. redanddead · 1790774883 · focus · HN ↗

               That sucks
            2. grim_io · 1790775270 · focus · HN ↗

               There is a difference.

               Using feedback on your sessions makes that session, and presumably all attached data, fair game for training.

               1. margalabargala · 1790779493 · focus · HN ↗

                  As if it wasn't already? The feedback button may tag it a certain way but the AI company certainly isn't going to let that sweet sweet user interaction go to waste just because they didn't rate it.

                  1. grim_io · 1790780004 · focus · HN ↗

                     If contracts didn't matter, sure I guess.

                     1. margalabargala · 1790781675 · focus · HN ↗

                        Are you under the mistaken impression that hitting a 1, 2, or 3 for bad/fine/good is itself sufficient permission to allow Anthropic to train off your chat?

                        They explicitly ask, after the rating, whether they can look at your chat. You can just say "no" to that, if you believe that they are following the rules they say they are.

                        Your original statement of "using feedback gives them permission to train" is just plain false.

                        1. grim_io · 1790783782 · focus · HN ↗

                           Truth be told, I never used the feedback function because of the clauses that reference the functionality in connection with training/service improvement.
         2. iamjackg · 1790775056 · focus · HN ↗

            How is it RLHF if they don't get a transcript of your session?
         3. Aachen · 1790791200 · focus · HN ↗

            A better product isn't something?

Unofficial Hacker News client; not affiliated with Y Combinator.