‹ BackHN Continuity

Thread

The Legend of von Neumann (1973) [pdf]

311 points · 186 comments · suopspaces

  1. srejk · · focus · HN ↗
    When you look at it holistically, von Neumann was more influential in science and mathematics in the 20th century than either Einstein or Planck. He wasn't as obvious a symbol of the scientific revolution, but his contributions to SO MANY THINGS at a fundamental level makes him stand out to me.
    1. snapetom · · focus · HN ↗
      Definitely my favorite physicist for the same reason you state. The notion that he just went around different fields and said “here’s how math can improve things,” invented some new approach, and moved on to another field to do it all over again just cracks me up.
      1. harpersealtako · · focus · HN ↗
        Nowadays we'd call that "engineer's disease". I wonder how many potential Von Neumanns were discouraged from branching out into other fields by jealous gatekeepers who assume that any interest in their field by "outsiders", especially technical people, is "epistemic trespassing".
        1. lalalandland · · focus · HN ↗
          For every von Neumann you probably have thousands if not millions of crack pots with ideas not worth wasting time on. So I understand the scepticism
          1. hnfong · · focus · HN ↗
            If people are assigned a "gatekeeping" position, they should at least be expected to be able to tell great minds from crack pots. (As opposed to just blindly applying a statistical filter)

            Otherwise why not just replace them with a script (or these days, an AI)

            1. qlte · · focus · HN ↗
              In this context "gatekeeper" is often defined as broadly as "any individual academic or researcher receiving a cold email".
            2. alwa · · focus · HN ↗
              Isn’t history replete with examples of great minds who were received as crackpots until, after careers’ worth of labor to validate them, some of their crazy ideas turned out to be correct?
              1. SideQuark · · focus · HN ↗
                The problem is the actual crackpots outnumber hidden gems by many orders of magnitude, so wasting time trying to sift through the noise is a losing proposition.

                And I don’t know many, if any, examples of people received as crackpots that later were considered genius. At worst genius takes a little time to be recognized, which is a situation far more common.

                1. tekla · · focus · HN ↗
                  I think maybe Srinivasa Ramanujan? Maybe not a full crackpot, but defo not worth spending time on because his work looked like Aliens came by and dropped a textbook.

                  I forget the quote, but one of the guys that recognized that he was worth looking into said something to the effect of "his work was too crazy for him to be crazy".

                  1. SideQuark · · focus · HN ↗
                    No one ever thought Ramanujuan a crackpot. Hardy immediately realized his genius and brought him to the UK.
          2. amunozo · · focus · HN ↗
            E.g., economics.
            1. IAmBroom · · focus · HN ↗
              I've literally never met a person who didn't consider themselves economically knowledgeable.

              It's like an analog to the fact that almost all people consider themselves funny.

              1. ahazred8ta · · focus · HN ↗
                Nothing is more fairly distributed than common sense: no one thinks he needs more of it than he already has. -- Descartes
              2. cindyllm · · focus · HN ↗

                [dead]

        2. chucksmash · · focus · HN ↗
          Seems to me it's less about gatekeepers and more whether what you bring to the table is useful to people in that field.

          If somebody truly believes they have a useful model then they don't discouraged by academic gatekeeping, they go and build Time Cube.

        3. cycomanic · · focus · HN ↗
          I have yet to meet a (academic) researcher that doesn't like to talk about their research topic if somebody comes and is genuinely interested. I mean most work on a topic that has maybe another 10-100 people in the world who are interested.

          The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.

          1. harpersealtako · · focus · HN ↗
            An example I can think of off the top of my head is Luis Alvarez, the nobel physicist who came up with the asteroid impact theory of dinosaur extinction. The geology and paleontology community shunned him until the 90s when the Chicxulub crater was discovered (though geology is historically infamous for this, to the extent that nearly every important paradigm shift in geology was made by non-geologist outsiders who faced ridicule for their theories)
            1. kaffekaka · · focus · HN ↗
              Geology moves slowly? Discipline name checks out at least.
          2. colinhb · · focus · HN ↗
            Yeah. I've been a part of a number of academic projects, and though my career has been in the private sector, my experience is that collaboration across fields and disciplines is relatively pain free (though maybe not a priority because the pathway to a pub and impact is not obvious). I think most people want to work with other interested people.

            In my limited experience, the friction is between labs and groups that are working on very similar things, and the competition is direct and obvious. And even here, the source of the conflict is the reward structures of the field, not some aversion to collaboration or personal arrogance.

        4. bmitc · · focus · HN ↗
          It's highly unlikely, I think, that another Von Neumann was prevented. He was a singular genius.

          However, the gatekeeping you mention definitely occurs to mere mortals who might have an interesting bend on existing ideas.

        5. KylerAce · · focus · HN ↗
          If someone is equal in talent to Von Neumann it's probably extremely difficult to discourage them enough via gatekeeping to stop them from making progress.
        6. jltsiren · · focus · HN ↗
          Usually that's because the engineer is not a very good engineer, at least outside their specialty. If they had studied engineering more, they would have probably learned that other engineers are already doing the thing they proposed.

          "Using methodology from a field known for its focus on methodology in another field" was still a novel idea in von Neumann's time. But because von Neumann and others did it, and because millions of people entered science after them, most combinations like that have already been tried. Breakthroughs from combining ideas from unrelated fields require something little less obvious these days.

      2. helterskelter2 · · focus · HN ↗
        Mandelbrot did this too, but he created a lot of animosity in the process because he could be really abrasive.
    2. JoeAltmaier · · focus · HN ↗
      It's odd that even today, different disciplines are still silo'd. My son started a research cross-database search engine because different disciplies use different terms for nearly identical concepts. Even within medicine it's silo'd.

      Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.

      1. flipping_beacon · · focus · HN ↗
        It's crazy that we talk about LLMs, AI/ML and what not but so many fields still don't use computation as much as we think they do simply because they cannot reliably keep up with the advancements happening almost everyday and people simply forgetting about backwards compatibility in their products
      2. sixtyj · · focus · HN ↗
        Is your son’s search engine somewhere available, please?
        1. JoeAltmaier · · focus · HN ↗
          It was something like 'Rugobi'. I'll ask him if there's a demo still up.
          1. JoeAltmaier · · focus · HN ↗
            HIs pubmed subscription expired.
      3. baruz · · focus · HN ↗
        A researcher submitted a paper to the medical journal _Diabetes care_ in the nineties that basically redescribed integral calculus as a novel finding. How’s that for a silo?
        1. mmulqueen · · focus · HN ↗
          For anyone else who is curious:

          <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Tai%27s_model" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Tai%27s_model

          <a href="https:&#x2F;&#x2F;pubmed.ncbi.nlm.nih.gov&#x2F;8137688&#x2F;" rel="nofollow">https:&#x2F;&#x2F;pubmed.ncbi.nlm.nih.gov&#x2F;8137688&#x2F;

          1. jablongo · · focus · HN ↗
            This is really funny. A less extreme example is how much domain-specific terminology in Reinforcement Learning and Control Theory&#x2F;Model Predictive Control refer to the same underlying phenomena, but we must translate between the two. I understand there are many unique concepts as well, but it would be so helpful if the overlap here used the same terminology and notation.
            1. Animats · · focus · HN ↗
              I still get IEEE Trans. on Control Theory, and it&#x27;s all machine learning now. Except that the controls people are desperately trying to solidify the underpinnings of machine learning, so that control systems don&#x27;t suddenly misbehave for some sets of inputs. Controls people want a guarantee that if it does something reasonable for inputs of 5.1 and 5.2, it doesn&#x27;t do something completely unexpected for an input of 5.15.
              1. donquichotte · · focus · HN ↗
                Reminds me of my favorite abstract, from John Doyle&#x27;s paper &quot;Guaranteed Margins for LQG Regulators&quot;.

                <a href="https:&#x2F;&#x2F;improbable.com&#x2F;wp-content&#x2F;uploads&#x2F;2011&#x2F;10&#x2F;ThereAreNone.gif" rel="nofollow">https:&#x2F;&#x2F;improbable.com&#x2F;wp-content&#x2F;uploads&#x2F;2011&#x2F;10&#x2F;ThereAreNo...

      4. api · · focus · HN ↗
        I always say knowledge is like a sweater. Pull a thread and the whole thing unravels. Everything is connected so if you start somewhere and never stop learning you&#x27;ll end up in every discipline. There&#x27;s also a good old Weezer song called Undone for this.
      5. [deleted] · · focus · HN ↗

        [deleted]

      6. IAmBroom · · focus · HN ↗
        My minor required me to take Electricity &amp; Magnetism from the physics department the same semester I had to take Fields &amp; Waves from the electrical engineering department.

        Yes, they were identical.

        My crib note that I took into the later final exam was simply a conversion between terms in the two departments. Nothing else; I&#x27;d already crammed and aced the first exam.

        1. analog31 · · focus · HN ↗
          Oddly enough, I got a physics degree, and then happened to teach the engineering course for one semester many years ago while in between jobs. I&#x27;m sure this varies from one college to the next. My impressions at the time were:

          The physics version was much more mathematical, and did things like solving everything in spherical coordinates. It also kind of served as a preparation for solving corresponding problems in quantum mechanics.

          The engineering version was more nuts-and-bolts, covering things like transformers, motors, and transmission lines. (Antennas were for a later course).

          As a consequence, teaching the engineering course required me to quickly learn a whole bunch of stuff that we glossed over or ignored in the physics course. While also teaching it. Fortunately I was an experimental physicist and had also done some work in industry, so the topics weren&#x27;t utterly unfamiliar.

          1. JoeAltmaier · · focus · HN ↗
            Fortunately the professional teacher only has to be one lesson ahead of the student.
    3. delichon · · focus · HN ↗
      Shannon may be gaining on him.
      1. cma · · focus · HN ↗
        I vote for Wiener at this point
        1. ricksunny · · focus · HN ↗
          I&#x27;m more of a Vannevar acolyte myself.
          1. DonHopkins · · focus · HN ↗
            I warmly invite you all to join the Church of the Eval Genius for only $35:

            <a href="https:&#x2F;&#x2F;github.com&#x2F;SimHacker&#x2F;moollm&#x2F;blob&#x2F;main&#x2F;designs&#x2F;eval&#x2F;CHURCH-OF-THE-EVAL-GENIUS.md" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;SimHacker&#x2F;moollm&#x2F;blob&#x2F;main&#x2F;designs&#x2F;eval&#x2F;C...

            The Holy Trinity:

            Father: Alonzo Church: L3 - lambda calculus, the name the institution bears

            Son: Alonzo (Snap! mascot) - Incarnation — Gobo, λ on his head

            Holy Ghost: λ - First-class procedures; β-reduction; eval-as-spirit

            Membership — Eternal Judgment ($35):

            <a href="https:&#x2F;&#x2F;github.com&#x2F;SimHacker&#x2F;moollm&#x2F;blob&#x2F;main&#x2F;designs&#x2F;eval&#x2F;CHURCH-EVAL-GENIUS-LITURGY.md#membership--eternal-judgment-35" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;SimHacker&#x2F;moollm&#x2F;blob&#x2F;main&#x2F;designs&#x2F;eval&#x2F;C...

            John von Neumann tried to hire Church&#x27;s own student, Turing, who declined. The Father begat the Machine; Johnny wanted to be its landlord.

            Ecumenical Outreach: All fans of other gods are welcome. Bring your Vannevar, your Shannon, your Wiener, your Johnny. In the Church of the Eval Genius every god is a procedure, and every procedure may be passed as an argument.

            1. rramadass · · focus · HN ↗
              Amen!

              Thine Church sits alongside &quot;The Church of Edsger Dijkstra&quot; and his Predicate Calculus and Program Semantics is its bible.

              Syntax is but mere &quot;ashes and dust&quot; while Semantics are &quot;eternal&quot;!

              And brother; hast thou forgotten &quot;The Church of Logic Programming&quot;?

              Ruled over by its venerated Pope, Robert Kowalski, who verily laid out its commandments in Predicate Logic as Programming Language and gaveth also the text espousing its central dictum, Algorithm = Logic + Control.

              Thine faith must needs be strengthened ;-)

    4. nkozyra · · focus · HN ↗
      He&#x27;s definitely the one guy from the 20th century I can&#x27;t really reconcile his capability and breadth, other than being an alien or a time traveller.
      1. skrellm · · focus · HN ↗
        An alien (a Martian to be precise), because Douglas Engelbart was the time traveler.
    5. tomrod · · focus · HN ↗
      Nash&#x27;s game theory dissertation was something von Neumann considered obvious and not particularly noteworthy, if I remember my lore right. He was among the first game theorists, focusing more on collaborative games than pure strategic&#x2F;competitive games.

      Einstein built on the shoulders of Riemann, Gauss, and others when considering the universe might be non-Euclidean!

      All brilliant people, many singular minds of great repute, yet, all improved by the rest.

      1. anthonypasq · · focus · HN ↗
        another famous piece of Von Neumann lore is that he constantly advocated nuking the Soviets.
        1. sillysaurusx · · focus · HN ↗
          I was wondering if someone would mention this.

          It&#x27;s interesting how much worse off the world would be if the smartest people were in charge of it.

          What ultimately blocked his nuke proposals? (Why didn&#x27;t anyone listen?) I&#x27;m curious about whatever failsafe that was.

          1. [deleted] · · focus · HN ↗

            [deleted]

          2. estearum · · focus · HN ↗
            1. Big assumption that the world would be worse off in that alternative future, no?

            2. Probably what blocked his proposals is that most people are loath to murder millions of other people (especially if they have ~any other option, including &quot;do nothing&quot;)

            1. myth_drannon · · focus · HN ↗
              It&#x27;s all psychological inertia. For example even if they knew that Communism would cause tens of millions of deaths they would not nuke USSR.
            2. podocarp · · focus · HN ↗
              How is nuking some other country a better future. How are you going to argue for that I wonder. You&#x27;re going to cause millions of deaths even without retaliation. How are you going to justify that, simply because &quot;they&#x27;re not us&quot;?
              1. nayroclade · · focus · HN ↗
                He described himself a &quot;violently anti-communist&quot;, and he saw nuclear war as an eventual necessity in a civilisational conflict between democracy and totalitarianism. If you view a nuclear war as unavoidable, it&#x27;s easy to conclude that it&#x27;s better to get it over with sooner rather than later, since a later war will be even more destructive. Especially since von Neumann was active in the 1940s and 50s, when the west had a slight edge in weapons technology, and before the development of the giant H-bombs. He and a few other pro-nuclear scientists argued there was a brief window where the USA could fight and win a nuclear war against the USSR, and they should take it.

                While it&#x27;s easy to dismiss that view in hindsight, it&#x27;s worth considering that von Neumann had personally witnessed the rise of the Nazis and had to flee along with many of his friends and family. And he had seen that regime defeated only by military strength of the USA. And while the USSR and USA never did end up in a nuclear war, it really was only by a series of miracles that it was avoided. I think most historians of the 20th century would agree we got very, very lucky.

                1. leonidasrup · · focus · HN ↗
                  Von Neumann family was affected also by the communist &quot;red terror&quot; in Hungary in 1919, and by the subsequent &quot;white terror&quot; of the militant anti-communist authoritarian government after 1919.

                  <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Hungary_between_the_World_Wars" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Hungary_between_the_World_Wars

              2. estearum · · focus · HN ↗
                I didn’t argue for any of those points. I just said the future is hard to predict (and the counterfactual past hard to trust), so a confident assertion that his preferred strategy would’ve been worse or better is pretty silly.
          3. hn_acc1 · · focus · HN ↗
            Not sure that it would be worse than letting the other end of the spectrum be in charge of it, as we&#x27;ve seen..
            1. IAmBroom · · focus · HN ↗
              We can&#x27;t know.

              As an extreme example, antisemitism was so commonly palatable that an open admirer of Hitler, Charles Lindbergh, was a very serious candidate for the presidency.

              Today, open antisemitism can get one&#x27;s career derailed in much of the world. Would that be true without the eye-opening shock that the news of the concentration camps produced?

              IN NOW WAY was the Holocaust forgivable, but we simply cannot say if the world today would be &quot;more moral on average&quot; or &quot;less moral on average&quot;. Maybe Jews would feel and be far less safe today in predominantly Christian countries. Maybe not.

              All we can say for certain is that the horrors enacted upon the Holocaust victims were evil. As we can surely say that murdering many millions of people living in the USSR would be.

              1. leonidasrup · · focus · HN ↗
                Nazism had lot of supporters in the US in the 1930s, before WW II.

                <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Nazism_in_the_Americas" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Nazism_in_the_Americas

                And even after WW II

                <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;National_Socialist_White_People&#x27;s_Party_(NSWPP)" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;National_Socialist_White_Peopl...

        2. senderista · · focus · HN ↗
          Even Bertrand Russell briefly advocated this. &quot;Better dead than Red.&quot;
      2. dempedempe · · focus · HN ↗
        Saying that von Neumann was one of the first game theorists undersells it.

        He wrote the original book on game theory! The Theory of Games and Economic Behavior with Oskar Morgenstern.

        Relatedly, MAD was his conception as well.

        1. mrandish · · focus · HN ↗
          &gt; He wrote the original book on game theory!

          I always found it endearing that von Neumann loved playing poker with friends but was admittedly terrible at it, regularly losing money.

      3. senderista · · focus · HN ↗
        I believe Nash himself didn&#x27;t consider it particularly noteworthy either, and was far prouder of his work in pure math (like the Nash embedding theorem).
      4. leonidasrup · · focus · HN ↗
        Einstein also cooperated, or competed, with another giant of mathematics, David Hilbert.

        &quot; By 1907, Einstein had framed the fundamentals of the theory of gravity, but then struggled for nearly 8 years to put the theory into its final form. By early summer 1915, Hilbert&#x27;s interest in physics had focused on general relativity, and he invited Einstein to Göttingen to deliver a week of lectures on the subject. Einstein received an enthusiastic reception at Göttingen. Over the summer, Einstein learned that Hilbert was also working on the field equations and redoubled his own efforts. During November 1915, Einstein published several papers culminating in The Field Equations of Gravitation (see Einstein field equations). Nearly simultaneously, Hilbert published &quot;The Foundations of Physics&quot;, an axiomatic derivation of the field equations (Einstein–Hilbert action). Hilbert fully credited Einstein as the originator of the theory and no public priority dispute concerning the field equations ever arose between the two men during their lives. &quot;

        <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;David_Hilbert" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;David_Hilbert

    6. gradus_ad · · focus · HN ↗
      Genuinely curious, because I know von Neumann was an intellectual giant, but what was his most original&#x2F;groundbreaking contribution? My impression of his work has always been that he would survey a field, find some particular problem that needed attending to, tidily solve it, then move on to some other domain. But I guess there&#x27;s a latent assumption there that he didn&#x27;t do anything huge or groundbreaking.
      1. curt15 · · focus · HN ↗
        &quot;Most&quot; involves great subjectivity, but how about laying the mathematical foundations for quantum mechanics?
      2. jungturk · · focus · HN ↗
        Battacharya&#x27;s The Man From the Future is an entertaining read (on JvN&#x27;s life and achievements)
        1. flopsamjetsam · · focus · HN ↗
          I&#x27;m reading this now, and can confirm it&#x27;s very entertaining, and gave me more perspective on his life and achievements (coming from a CS background).
        2. mkl · · focus · HN ↗
          *Bhattacharya
          1. mkl · · focus · HN ↗
            Not an idle complaint. My library&#x27;s search isn&#x27;t fuzzy enough for the misspelled name to work.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.