‹ BackHN Continuity

Thread

America.gov

778 points · 742 comments · plesiv

  1. maherbeg · · focus · HN ↗
    OK, there's a lot of negative comments here, but this is a great idea at a high level. It really is hard to figure out where to do a thing and it's also very easy to get phished. If they can figure out how to help people get all the services they're eligible for that'll be an amazing improvement for the people.
    1. gthrow12345 · · focus · HN ↗
      I agree in general, but how do you resolve the problem that people will take the output of the chatbot as authoritative even when it could possibly have errors or miss important nuance? People being lead astray with information from the government could lead to very serious consequences, up to and including imprisonment.

      Honest question, I had the same issue when my work wanted me to stick a chatbot in front of our HR portal and I never resolved it to my satisfaction.

      1. rayiner · · focus · HN ↗
        > but how do you resolve the problem that people will take the output of the chatbot as authoritative even when it could possibly have errors or miss important nuance

        You have to measure that problem against the status quo, which is that current government websites are very hard to understand and leave people with very little idea of what’s going on.

        1. andrewflnr · · focus · HN ↗
          One of the only things more dangerous than ignorance is false confidence. An official USG chatbot potentially makes things much worse.
          1. kulahan · · focus · HN ↗
            Better remove humans from the equation, then.
            1. toofy · · focus · HN ↗
              no. humans can be held accountable and learn from their mistakes.

              they can be taught where they went wrong.

              if a pattern emerges they can be moved to a role more fitting for them. or removed from a project entirely.

              we can judge their effectiveness from past performance.

              we can put them in less important roles and gauge whether or not they should be moved up.

              so, no, pretending that the correct route forward is to “remove humans from the equation” for a bot that doesn’t learn, is never held accountable, and not held to the same standard as humans is silly tier thinking.

              1. olmo23 · · focus · HN ↗
                > humans can be held accountable and learn from their mistakes

                bad bots can be retrained or shut down far more easily

                1. toofy · · focus · HN ↗
                  depending on which model one is using, and the error the employee needs to be retrained on, i strongly disagree that you can retrain an llm as easily as you can a person.

                  particularly most of the commercial models.

                  again, i’m sure we can all come up with a thousand “hypotheticals”, but i’ll state again, “entirely removing human” from the situation is silly.

                  particularly as even the ceos of frontier producing models will each and every single one tell you to never trust their model.

                  “our model is smartest thing in the world…”

                  …next breath..

                  “wait, you trusted our model? that was silly of you. always double check it”

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.