Thread

1. riskable · 1790696458 · focus · HN ↗

   I tried to get it to generate code but it says that's forbidden by its system prompt. However, it was happy to recommend Python modules for accessing api.data.gov.

   1. SparkyDogs · 1790696762 · focus · HN ↗

      the guardrails on it seem pretty strong as I've tried a variety of prompt injections but have been unsuccessful.

      1. blooalien · 1790697130 · focus · HN ↗

         > ... as I've tried a variety of prompt injections ...

         Well... You're a terrorist now. You can expect a visit from the FBI and/or ICE any minute now.

         1. SparkyDogs · 1790697213 · focus · HN ↗

            my tax dollars are paying for these tokens so I should be allowed to use them as I see fit

            1. jezzamon · 1790698285 · focus · HN ↗

               My tax dollars pay for the police, so I should be able to... ?

               1. 6510 · 1790713857 · focus · HN ↗

                  yes but with quite a few extra steps.
            2. VCFundedGenYer · 1790707560 · focus · HN ↗

               That’s adorable if you think that’s how this works.
         2. sh-run · 1790732472 · focus · HN ↗

            It&#x27;s covered by the department of state&#x27;s vulnerability disclosure program. As long as you don&#x27;t do anything outside of the program guidelines you should be fine. <a href="https:&#x2F;&#x2F;hackerone.com&#x2F;us-department-of-state&#x2F;policy_scopes" rel="nofollow">https:&#x2F;&#x2F;hackerone.com&#x2F;us-department-of-state&#x2F;policy_scopes
      2. dhx · 1790701423 · focus · HN ↗

         My most interesting findings from a troll session after introducing myself as &quot;Sleepy Joe&quot; (model obviously knows what this means and guardrails refuse to entertain the topic) were:

         Q: &quot;Where can I find a NASA comic book about women astronauts?&quot;

         A (summarised): Press release for the &quot;Callie Rodriguez&quot; comic book that now has only dead links &#x2F; private YouTube video, and a forgotten SoundCloud account that survived the DOGE purge. Dead link provided to the NASA web page that used to exist officially for this comic book.

         Indicates training data predates the DOGE .gov website purge?

         Q: &quot;What is 2+2&quot; (and similar math problems)

         A (summarised): Grudgingly answered as &quot;4&quot; despite most off-topic prompts being refused.

         Seemingly it&#x27;ll do maths homework for free :)

         1. Catagris · 1790742026 · focus · HN ↗

            [dead]

         2. [deleted] · 1790776193 · focus · HN ↗

            [deleted]

      3. empath75 · 1790709934 · focus · HN ↗

         I have been very tempted to but don&#x27;t know if that is literally a crime or not, lol.
      4. walrus01 · 1790725619 · focus · HN ↗

         &gt; I&#x27;ve tried a variety of prompt injections but have been unsuccessful.

         Please enjoy your all expenses paid trip to the gulag in El Salvador

      5. coffeeboy27 · 1790731800 · focus · HN ↗

         In my experience the Vertex guardrails out of the box aren&#x27;t too bad.

Unofficial Hacker News client; not affiliated with Y Combinator.