‹ BackHN Continuity

Thread

How do we prevent mathemathics from devolving into the Medieval Era of secrecy?

158 points · 146 comments · jjgreen

  1. rramadass · · focus · HN ↗
    > Regardless of the true cost, it seems that professional mathematicians now need to wary about what they put into a LLM and think hard about how to disclose and publish a result.

    This is all but guaranteed now.

    Mathematicians/Scientists/Researchers need to stop sharing freely with "AI Companies" and have explicit clauses in place in their publications about not using their research without their explicit consent.

    There should be a clear legal distinction between using research data for AI model-training vs. another researcher using it.

    Come up with a legal framework, establish procedures for sharing and using others work and have a single scientific body in charge of enforcing it.

    1. nradov · · focus · HN ↗
      Just putting a clause in a publication won't prevent it from being used as training data. Information wants to be free.

      The frontier LLM vendors do sell enterprise licenses which contractually guarantee that your prompts won't be used for training. (Maybe they'll secretly violate the agreement but in principle it's legally enforceable.) Scholars and universities who care about credit and attribution will either have to purchase those licenses or run their own private open-weight LLM instances.

      1. Analemma_ · · focus · HN ↗
        I don't like this and I wish it weren't true, but I think the period of "information wants to be free" is coming to an end, it was a relic of a bygone era. Increasingly, making your information free means you're the sucker who is doing free labor for AI companies, or worse, you're helping your competitors. Paywalls, login walls, and rate-limits are going up everywhere: there's the GitLab news on the home page right now, and sites like Twitter, Reddit etc. which used to be publicly-readable are now gated (and Xitter is using the legal system to shut down any bypasses).

        I hate this but I don't think there's any going back now that LLMs exist.

        1. pavel_lishin · · focus · HN ↗
          "Information wants to be free" never meant that people want to release their information; it meant that information is very hard to keep secret, and that everything leaks like a sieve, and especailly that once it's out, it's out forever.
          1. nradov · · focus · HN ↗
            Exactly. While there are a few academics who work in private for years and then surprise the world with an amazing breakthrough, most of modern science and mathematics is a collaborate process. Researchers make gradual progress on hard problems, and discuss issues with colleagues and students along the way. Some of those collaborators will then pass on the information to social media or public discussion forums or free-tier LLM prompts or whatever and it gets incorporated into the next round of training runs.

            Two people can keep a secret if one of them is dead.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.