My favorite von Neumann anecdote was a quote from Edward Teller: "von Neumann would carry on a conversation with my 3 year old son, and the two of them would talk as equals, and I sometimes wondered if he used the same principle when he talked to the rest of us."
When you look at it holistically, von Neumann was more influential in science and mathematics in the 20th century than either Einstein or Planck. He wasn't as obvious a symbol of the scientific revolution, but his contributions to SO MANY THINGS at a fundamental level makes him stand out to me.
It's odd that even today, different disciplines are still silo'd. My son started a research cross-database search engine because different disciplies use different terms for nearly identical concepts. Even within medicine it's silo'd.
Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.
A researcher submitted a paper to the medical journal _Diabetes care_ in the nineties that basically redescribed integral calculus as a novel finding. How’s that for a silo?
This is really funny. A less extreme example is how much domain-specific terminology in Reinforcement Learning and Control Theory/Model Predictive Control refer to the same underlying phenomena, but we must translate between the two. I understand there are many unique concepts as well, but it would be so helpful if the overlap here used the same terminology and notation.
I still get IEEE Trans. on Control Theory, and it's all machine learning now. Except that the controls people are desperately trying to solidify the underpinnings of machine learning, so that control systems don't suddenly misbehave for some sets of inputs. Controls people want a guarantee that if it does something reasonable for inputs of 5.1 and 5.2, it doesn't do something completely unexpected for an input of 5.15.
It's crazy that we talk about LLMs, AI/ML and what not but so many fields still don't use computation as much as we think they do simply because they cannot reliably keep up with the advancements happening almost everyday and people simply forgetting about backwards compatibility in their products
My minor required me to take Electricity & Magnetism from the physics department the same semester I had to take Fields & Waves from the electrical engineering department.
Yes, they were identical.
My crib note that I took into the later final exam was simply a conversion between terms in the two departments. Nothing else; I'd already crammed and aced the first exam.
I always say knowledge is like a sweater. Pull a thread and the whole thing unravels. Everything is connected so if you start somewhere and never stop learning you'll end up in every discipline. There's also a good old Weezer song called Undone for this.
Nash's game theory dissertation was something von Neumann considered obvious and not particularly noteworthy, if I remember my lore right. He was among the first game theorists, focusing more on collaborative games than pure strategic/competitive games.
Einstein built on the shoulders of Riemann, Gauss, and others when considering the universe might be non-Euclidean!
All brilliant people, many singular minds of great repute, yet, all improved by the rest.
I believe Nash himself didn't consider it particularly noteworthy either, and was far prouder of his work in pure math (like the Nash embedding theorem).
1. Big assumption that the world would be worse off in that alternative future, no?
2. Probably what blocked his proposals is that most people are loath to murder millions of other people (especially if they have ~any other option, including "do nothing")
John von Neumann tried to hire Church's own student, Turing, who declined. The Father begat the Machine; Johnny wanted to be its landlord.
Ecumenical Outreach: All fans of other gods are welcome. Bring your Vannevar, your Shannon, your Wiener, your Johnny. In the Church of the Eval Genius every god is a procedure, and every procedure may be passed as an argument.
Definitely my favorite physicist for the same reason you state. The notion that he just went around different fields and said “here’s how math can improve things,” invented some new approach, and moved on to another field to do it all over again just cracks me up.
Nowadays we'd call that "engineer's disease". I wonder how many potential Von Neumanns were discouraged from branching out into other fields by jealous gatekeepers who assume that any interest in their field by "outsiders", especially technical people, is "epistemic trespassing".
Usually that's because the engineer is not a very good engineer, at least outside their specialty. If they had studied engineering more, they would have probably learned that other engineers are already doing the thing they proposed.
"Using methodology from a field known for its focus on methodology in another field" was still a novel idea in von Neumann's time. But because von Neumann and others did it, and because millions of people entered science after them, most combinations like that have already been tried. Breakthroughs from combining ideas from unrelated fields require something little less obvious these days.
I have yet to meet a (academic) researcher that doesn't like to talk about their research topic if somebody comes and is genuinely interested. I mean most work on a topic that has maybe another 10-100 people in the world who are interested.
The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.
An example I can think of off the top of my head is Luis Alvarez, the nobel physicist who came up with the asteroid impact theory of dinosaur extinction. The geology and paleontology community shunned him until the 90s when the Chicxulub crater was discovered (though geology is historically infamous for this, to the extent that nearly every important paradigm shift in geology was made by non-geologist outsiders who faced ridicule for their theories)
If people are assigned a "gatekeeping" position, they should at least be expected to be able to tell great minds from crack pots. (As opposed to just blindly applying a statistical filter)
Otherwise why not just replace them with a script (or these days, an AI)
If someone is equal in talent to Von Neumann it's probably extremely difficult to discourage them enough via gatekeeping to stop them from making progress.
For a longer read, I can highly recommend the book "The Man from the Future" by Ananyo Bhattacharya. It's quite an easy read and extensively discusses the life and discoveries by John von Neumann in chronological order.
I had to frequently pause my read to research a discovery in more depth to understand the significance of it and I got a chuckle when he marries his childhood sweetheart because she got no mention prior to that point in the book.
He's my favourite mathematician too. Loved The Man from the Future book. Can we get a frontier model named after him perhaps? "Johnny" would be a great codename imo
Not sure what just happened but like 10 comments just vanished. Anyway, here's a wiki link to "The Martians" which was a group of Hungarian scientists and Von Neuman was a member.
"The Martians" (Hungarian: "A marslakók") were a group of prominent scientists (mostly, but not exclusively, physicists and mathematicians) of Hungarian Jewish descent who emigrated from Europe to the United States in the early half of the 20th century.[1]
Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars."
You might not have "show dead" enabled in your settings. There is an antisemitic comment that was flagged and is now "dead" with a bunch of replies - so you would have seen those, and then now not see them if you don't have "show dead" enabled.
I think that with showdead off, if a flagged comment has non-flagged replies, the toplevel comment will still show up as [flagged] and the replies will be visible. Flagged comments are usually collapsed, though, which might be why it seemed like the discussion tree disappeared.
Von Nuemann is one of those names that when ever it comes up I sarcastically mentally note "John f***ing Neumann, AGAIN!". It's happened so many times in my studies that I think he might be the most important scientist to have ever lived.
He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)
Do you have inside info about that inspiration? At one point a human character monitoring from space thinks Underhill seems like several Dawn Age geniuses rolled into one and thinks he must be a figurehead for a collective (iirc). But that's a bit different from the author taking off mainly from him. vN isn't mainly known as a font of crazy ideas -- more like supremely fast & precise intellect.
> He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky.
Oh, hell-- that totally makes sense and I completely missed it until now. Thanks for mentioning that-- it adds some additional depth to a book and a character I already enjoy a ton.
I know of several von Neumann like stories that people tell about me about things like instant memorization, fast calculation, and instant problem solving. There is almost always a trick that I didn't reveal to the person experiencing the miracle for the same reason a magician doesn't reveal their tricks: it's more fun for the person to figure it out on their own.
I liked the book, it uses an interesting storytelling mechanism of telling each chapter through the lens of a different historical character (his mom, his wife, friends, etc). But I think Labatut sacrificed voice and tone a little bit (there weren’t too many elements to differentiate between each narrator).
I haven't read MANIAC (yet) but a few years back I was trying to find a good biography of Von Neumann and there are not many; the problem is that he's really difficult to cover comprehensively, even for science historians, because he impacted so many areas of science that you'd practically have to be a von Neumann to create a biography of von Neumann. One could probably get a rough idea of his intelligence by how many science historians it would take to create a comprehensive biography which explains his life and work to a reasonably intelligent layman.
I occasionally wonder... who is the von Neumann of today. Where are they? What are they working on? Are they being given everything they might need to focus on their work? How can we find them? What signal are we looking for?
von Neumann is one of the very very few people that I struggle to place in any single template. From all the facts already present in the pdf and elsewhere, it does become immediately obvious that he had both superhuman memory and an extremely fast processor (although it is unclear if his brain followed a von Neumann architecture).
My template had guessed,
"sounds like someone who enjoyed working in quiet spaces" -> Nope, he liked loud environments to get his brain going (apparently Einstein once complained about Neumann being noisy)
"he would have been a focused person" -> Nope, he never worked on anything for too long
"unlikely to be motivated by money" -> Nope, he famously “loved money” according to Wigner [1]
"probably not someone who stares at women" -> nope, at Los Alamos, secretaries sometimes put cardboard across the open fronts of their desks because otherwise Neumann would stare
Tl;Dr: I find him fascinating.
[1]: interestingly, there was a group of Jewish Hungarian scientists - von Neumann, Eugene Wigner, Leo Szilard, Edward Teller, and Theodore von Karman - all brilliant, all born within one-mile-radius circle in downtown Budapest, all emigrated to the US, collectively known as Martians by their colleagues.
Feymann shared these qualities too, but seems he would have been more interesting to meet - more of a normal, yet brilliantly smart, person, unlike Von Neumann who while being a bon vivant also seems to have been a bit "off" with his inability to drive safely, not remembering where the drinking glasses in his own house were, etc.
> It was established terminology by 1973, as far as I can tell
That's a worthwhile observation. The 1973 article anyway doesn't go into depth about comparative computer architecture. It's also possible the term's currency in computer science circles hadn't yet crossed into Halmos' mathematics circles, but I wouldn't know.
The conclusion is that von Neumann deserves the credit for the "von Neumann architecture", despite any contrary claims of Eckert or Mauchly.
Herman Goldstine, who distributed the document and John von Neumann, who wrote it, are the reason for the explosive growth of the computer industry during the following decades.
The paper written by von Neumann was an exemplary model of clarity and good logical thinking. Nothing ever written by Eckert or Mauchly was at a comparable level.
Everyone who read that paper understood immediately how to design and build an electronic automatic computer, and a great number of teams in many countries all over the world did precisely this, so a decade later there already existed experimental electronic computers in many countries and also commercial electronic computers in the UK and in USA.
Some of the details from the paper must have been learned by von Neumann from discussions with the ENIAC team, but others were obviously von Neumann's own ideas, e.g. the use for the main memory of an iconoscope tube with fast random access, i.e. a DRAM like today, instead of the slow serial delay lines chosen by Eckert and Mauchly for their following computers.
Whatever von Neumann has learned from the ENIAC team, he obviously understood better than the people who taught him, allowing him to formulate general principles for the organization of an automatic computer.
The publication of the von Neumann paper allowed the concurrent development of many computers in many places, and each of those projects found various improvements that were essential in making the electronic computers successful commercial products.
If Eckert and Mauchly had succeeded to block any competitors, then the evolution of computers might have been delayed by up to 2 decades, until any patents would have expired, because Eckert and Mauchly have never done later any significant innovations and they would have never succeeded to develop better computers at the pace that happened due to the von Neumann paper.
Moreover, Eckert and Mauchly had a history themselves of failing to mention their sources of inspiration, so they were not the people entitled to complain about someone "stealing" ideas from them.
Before ENIAC, the first electronic computer in USA was the Atanasoff-Berry computer. That computer was a special-purpose computer, designed for solving systems of linear algebraic equations. However, ENIAC was a special-purpose computer too, unlike the relay-based computers that were older than it, like the Harvard Mark I computer, as even its name implies (Numerical Integrator and Computer).
ENIAC was conceived as a replacement for the older mechanical "differential analyzers", which were used to solve ordinary differential equations, e.g. for computing artillery tables, so its architecture mimicked the architecture of the mechanical differential analyzers, and it was reconfigured for new problems in a similar manner with those, by rewiring.
John Vincent Atanasoff had written in 1940 a very high-quality document about the design of his computer: “Computing Machine for the Solution of Large Systems of Linear Algebraic Equations”. It is unknown if anyone of the ENIAC team had read it, but it is known that one of them had visited the designers of the Atanasoff-Berry computer, inquiring about the electronic circuits used by them to implement arithmetic operations and data storage. Later, during the design of ENIAC and after that, they never mentioned any connection with the earlier electronic computer.
Von Neumann's architecture (i.e. report on the EDVAC) didn't focus on random-access memory, and in fact his whole discussion on memory is rather rambling. The EDVAC itself, which the report is nominally describing, used serial-access mercury delay line memory. What really matters from an architectural POV is memory address-ability, not speed of access (random vs serial).
The whole document is, as the title promises, really more of an engineering one - a report on the EDVAC - rather than some clean abstract treatise on computer architecture.
Perhaps, and thanks for contributing that; and I'm not taking a position currently on this. But I've long been uncomfortable with the term 'random access' for random access memory (RAM) as it implies that the concept of 'randomness' is somehow a required and fundamental property of the memory technology described, when it's not. 'Arbitrary access' is a much more appropriately encapsulating description of the function of the memory at hand. Alas, the incumbency of terminology.
Nonetheless, the programs whose performance is limited by the speed of the main memory can be divided in programs whose performance is limited by the throughput of the memory interface and programs whose performance is limited by the latency of the memory accesses.
The programs from the first class will have the same performance when using a serial memory or a RAM, if they are equally fast for sequential access, but for programs from the second class, it is important to have a RAM as the main memory, otherwise they would be very slow.
In order to measure the performance achievable by programs from the second class on a given computer, it is necessary to run a benchmark where the addresses of the memory accesses are generated by a good random-number generator.
The reason is that modern CPUs have a variety of hardware prefetchers that attempt to predict the next memory address, so for meaningful results that reflect the true performance of the memory you need truly random addresses that are impossible to guess by the hardware.
Thus nowadays the latency of the memory accesses of a RAM cannot be measured otherwise than with really random accesses and a memory chip must be designed to have a low latency even when successive accesses happen at unpredictable random addresses, not only when the accesses are at arbitrary addresses, but those can be predicted in advance of the actual accesses.
So there is an argument in favor of the term RAM, because random access is the worst possible case and the memory must still be able to handle it.
The end of life section is a bit whitewashed. Freeman Dyson had an article (struggling to find it) about how von Neumann was invited to give a Hilbert-style lecture on the 10 problems for the new computing age. All the big names at the time were there, but von Neumann was in such poor shape (dementia I assume), that it was decided to pretend it had never happened.
This seems relevant to the current debate on the role of AI in mathematics:
What made von Neumann great? Was it the extraordinary rapidity with which
he could understand and think and the unusual memory that retained everything
he had once thought through? No. These qualities, however impressive they might
have been, are ephemeral; they will have no more effect on the mathematics and the
mathematicians of the future than the prowess of an athlete of a hundred years ago
has on the sport of today.
They're making a comparison to AI, because it has similar qualities (rapid understanding and "perfect" memory). Will AI also be ephemeral or having a lasting impact on mathematics like von Neumann.
Authored by Paul Halmos. He wrote Finite-Dimensional Vector Spaces, which was assigned textbook for my Linear Algebra course. A humbling read for me, coming from calc 3 and thinking I was hot shit. Stripped me of any illusions of becoming a mathematician.
I remember reading about how he was also a pioneer in using early supercomputers to predict weather patterns in meteorology. I never thought to combine supercomputers and weather before.
OT: I found this style of writing extremely clear and readable. I wonder what is different about this author’s writing. There is zero pretension and just exists to impart information. But if that’s the case why do I hate the writing in Wikipedia?
Because Paul Halmos was an exceptionally good writer. (I greatly enjoyed his "automathography" called "I want to be a mathematician", though it will probably appeal significantly less to people who aren't mathematicians themselves. See also his article "How to write mathematics" at https://www.math.toronto.edu/mgsa/assets/teaching-seminar/ho....)
The average Wikipedia contributor (even ignoring the possibility that they might be a robot) is not an exceptionally good writer, because very few people are exceptionally good writers, because that's what "exceptionally" means.
Why not? Von Neumann himself did, in a lighthearted way.
> I told Banach about an expression Johnny had used with me in Princeton before stating some non-Jewish mathematician's result, "Die Goim haben den folgenden satz beweisen" (The goys have proved the following theorem). Banach, who was pure goy, thought it was one of the funniest sayings he had ever heard. He was enchanted by its implication that if the goys could do it, then Johnny and I ought to be able to do it better. Johnny did not invent this joke, but he liked it and we started using it.
The Martians (of which von Neumann is usually the most regarded) were mostly Hungarian jews. It's a point on which some people have mused, so it's easy for the thought to point in that direction when von Neumann is brought up.
That may very well be true, but none of those has published anything of comparable importance and quality as any of the many publications of von Neumann.
Whether some people have really superior intellects is completely irrelevant for the rest of the humans unless they distribute to the others some useful products of their intellect.
Von Neumann is one of the hundreds of people from the past who have left a priceless intellectual heritage to me and to the remainder of the mankind, so I am indebted and grateful to them.
I have no reason to feel any debt or gratitude to any of the employees of OpenAI or Anthropic.
Jane Street has published a few useful articles, so I have some gratitude towards them, but none of those was even remotely similar in importance to any page written by von Neumann.
It's an interesting discussion topic. If we have people today who are just as smart and industrious as Neumann, why aren't they making a worldwide impact? Or, if they are, why is the attribution going to the companies they work for instead of them?
It raises questions like, is it even possible to work for a company while getting credit for world-changing results?
And it implies that at any point in time, there might be thousands of Neumanns in the world, and that initial conditions matter a lot more than ability.
Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.
https://en.wikipedia.org/wiki/Tai%27s_model
https://pubmed.ncbi.nlm.nih.gov/8137688/
Yes, they were identical.
My crib note that I took into the later final exam was simply a conversion between terms in the two departments. Nothing else; I'd already crammed and aced the first exam.
Einstein built on the shoulders of Riemann, Gauss, and others when considering the universe might be non-Euclidean!
All brilliant people, many singular minds of great repute, yet, all improved by the rest.
He wrote the original book on game theory! The Theory of Games and Economic Behavior with Oskar Morgenstern.
Relatedly, MAD was his conception as well.
It's interesting how much worse off the world would be if the smartest people were in charge of it.
What ultimately blocked his nuke proposals? (Why didn't anyone listen?) I'm curious about whatever failsafe that was.
2. Probably what blocked his proposals is that most people are loath to murder millions of other people (especially if they have ~any other option, including "do nothing")
https://github.com/SimHacker/moollm/blob/main/designs/eval/C...
The Holy Trinity:
Father: Alonzo Church: L3 - lambda calculus, the name the institution bears
Son: Alonzo (Snap! mascot) - Incarnation — Gobo, λ on his head
Holy Ghost: λ - First-class procedures; β-reduction; eval-as-spirit
Membership — Eternal Judgment ($35):
https://github.com/SimHacker/moollm/blob/main/designs/eval/C...
John von Neumann tried to hire Church's own student, Turing, who declined. The Father begat the Machine; Johnny wanted to be its landlord.
Ecumenical Outreach: All fans of other gods are welcome. Bring your Vannevar, your Shannon, your Wiener, your Johnny. In the Church of the Eval Genius every god is a procedure, and every procedure may be passed as an argument.
"Using methodology from a field known for its focus on methodology in another field" was still a novel idea in von Neumann's time. But because von Neumann and others did it, and because millions of people entered science after them, most combinations like that have already been tried. Breakthroughs from combining ideas from unrelated fields require something little less obvious these days.
The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.
Otherwise why not just replace them with a script (or these days, an AI)
If somebody truly believes they have a useful model then they don't discouraged by academic gatekeeping, they go and build Time Cube.
However, the gatekeeping you mention definitely occurs to mere mortals who might have an interesting bend on existing ideas.
https://en.wikipedia.org/wiki/The_Martians_(scientists)
"The Martians" (Hungarian: "A marslakók") were a group of prominent scientists (mostly, but not exclusively, physicists and mathematicians) of Hungarian Jewish descent who emigrated from Europe to the United States in the early half of the 20th century.[1]
Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars."
He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)
Oh, hell-- that totally makes sense and I completely missed it until now. Thanks for mentioning that-- it adds some additional depth to a book and a character I already enjoy a ton.
The legend of John von Neumann (1973) - https://news.ycombinator.com/item?id=8212335 - Aug 2014 (65 comments)
The Legend of John von Neumann - https://news.ycombinator.com/item?id=1427906 - June 2010 (4 comments)
(Reposts are fine after a year or so; links to past threads are just to satisfy extra-curious readers)
John von Neumann Shot Lightning from His Arse (2025) - https://news.ycombinator.com/item?id=45930838 (5 comments)
I know of several von Neumann like stories that people tell about me about things like instant memorization, fast calculation, and instant problem solving. There is almost always a trick that I didn't reveal to the person experiencing the miracle for the same reason a magician doesn't reveal their tricks: it's more fun for the person to figure it out on their own.
https://en.wikipedia.org/wiki/The_MANIAC
For those who've read other books on von Neumann, do you think The MANIAC is a reasonable summary?
it covers von Nuemann’s time developing the IAS machine at Princeton.
[0] https://www.penguinrandomhouse.com/books/44425/turings-cathe...
My template had guessed,
"sounds like someone who enjoyed working in quiet spaces" -> Nope, he liked loud environments to get his brain going (apparently Einstein once complained about Neumann being noisy)
"he would have been a focused person" -> Nope, he never worked on anything for too long
"unlikely to be motivated by money" -> Nope, he famously “loved money” according to Wigner [1]
"probably not someone who stares at women" -> nope, at Los Alamos, secretaries sometimes put cardboard across the open fronts of their desks because otherwise Neumann would stare
Tl;Dr: I find him fascinating.
[1]: interestingly, there was a group of Jewish Hungarian scientists - von Neumann, Eugene Wigner, Leo Szilard, Edward Teller, and Theodore von Karman - all brilliant, all born within one-mile-radius circle in downtown Budapest, all emigrated to the US, collectively known as Martians by their colleagues.
https://news.ycombinator.com/item?id=49870485
That's a worthwhile observation. The 1973 article anyway doesn't go into depth about comparative computer architecture. It's also possible the term's currency in computer science circles hadn't yet crossed into Halmos' mathematics circles, but I wouldn't know.
Herman Goldstine, who distributed the document and John von Neumann, who wrote it, are the reason for the explosive growth of the computer industry during the following decades.
The paper written by von Neumann was an exemplary model of clarity and good logical thinking. Nothing ever written by Eckert or Mauchly was at a comparable level.
Everyone who read that paper understood immediately how to design and build an electronic automatic computer, and a great number of teams in many countries all over the world did precisely this, so a decade later there already existed experimental electronic computers in many countries and also commercial electronic computers in the UK and in USA.
Some of the details from the paper must have been learned by von Neumann from discussions with the ENIAC team, but others were obviously von Neumann's own ideas, e.g. the use for the main memory of an iconoscope tube with fast random access, i.e. a DRAM like today, instead of the slow serial delay lines chosen by Eckert and Mauchly for their following computers.
Whatever von Neumann has learned from the ENIAC team, he obviously understood better than the people who taught him, allowing him to formulate general principles for the organization of an automatic computer.
The publication of the von Neumann paper allowed the concurrent development of many computers in many places, and each of those projects found various improvements that were essential in making the electronic computers successful commercial products.
If Eckert and Mauchly had succeeded to block any competitors, then the evolution of computers might have been delayed by up to 2 decades, until any patents would have expired, because Eckert and Mauchly have never done later any significant innovations and they would have never succeeded to develop better computers at the pace that happened due to the von Neumann paper.
Moreover, Eckert and Mauchly had a history themselves of failing to mention their sources of inspiration, so they were not the people entitled to complain about someone "stealing" ideas from them.
Before ENIAC, the first electronic computer in USA was the Atanasoff-Berry computer. That computer was a special-purpose computer, designed for solving systems of linear algebraic equations. However, ENIAC was a special-purpose computer too, unlike the relay-based computers that were older than it, like the Harvard Mark I computer, as even its name implies (Numerical Integrator and Computer).
ENIAC was conceived as a replacement for the older mechanical "differential analyzers", which were used to solve ordinary differential equations, e.g. for computing artillery tables, so its architecture mimicked the architecture of the mechanical differential analyzers, and it was reconfigured for new problems in a similar manner with those, by rewiring.
John Vincent Atanasoff had written in 1940 a very high-quality document about the design of his computer: “Computing Machine for the Solution of Large Systems of Linear Algebraic Equations”. It is unknown if anyone of the ENIAC team had read it, but it is known that one of them had visited the designers of the Atanasoff-Berry computer, inquiring about the electronic circuits used by them to implement arithmetic operations and data storage. Later, during the design of ENIAC and after that, they never mentioned any connection with the earlier electronic computer.
The whole document is, as the title promises, really more of an engineering one - a report on the EDVAC - rather than some clean abstract treatise on computer architecture.
https://web.archive.org/web/20130314123032/http://qss.stanfo...
Nonetheless, the programs whose performance is limited by the speed of the main memory can be divided in programs whose performance is limited by the throughput of the memory interface and programs whose performance is limited by the latency of the memory accesses.
The programs from the first class will have the same performance when using a serial memory or a RAM, if they are equally fast for sequential access, but for programs from the second class, it is important to have a RAM as the main memory, otherwise they would be very slow.
In order to measure the performance achievable by programs from the second class on a given computer, it is necessary to run a benchmark where the addresses of the memory accesses are generated by a good random-number generator.
The reason is that modern CPUs have a variety of hardware prefetchers that attempt to predict the next memory address, so for meaningful results that reflect the true performance of the memory you need truly random addresses that are impossible to guess by the hardware.
Thus nowadays the latency of the memory accesses of a RAM cannot be measured otherwise than with really random accesses and a memory chip must be designed to have a low latency even when successive accesses happen at unpredictable random addresses, not only when the accesses are at arbitrary addresses, but those can be predicted in advance of the actual accesses.
So there is an argument in favor of the term RAM, because random access is the worst possible case and the memory must still be able to handle it.
edit: article is called Birds and Frogs, by Freeman Dyson https://wucj.lab.westlake.edu.cn/Others/Dyson_Birds_and_Frog...
What made von Neumann great? Was it the extraordinary rapidity with which he could understand and think and the unusual memory that retained everything he had once thought through? No. These qualities, however impressive they might have been, are ephemeral; they will have no more effect on the mathematics and the mathematicians of the future than the prowess of an athlete of a hundred years ago has on the sport of today.
https://www.youtube.com/watch?v=OH2ZVSDYgK0
The average Wikipedia contributor (even ignoring the possibility that they might be a robot) is not an exceptionally good writer, because very few people are exceptionally good writers, because that's what "exceptionally" means.
> I told Banach about an expression Johnny had used with me in Princeton before stating some non-Jewish mathematician's result, "Die Goim haben den folgenden satz beweisen" (The goys have proved the following theorem). Banach, who was pure goy, thought it was one of the funniest sayings he had ever heard. He was enchanted by its implication that if the goys could do it, then Johnny and I ought to be able to do it better. Johnny did not invent this joke, but he liked it and we started using it.
https://infoproc.blogspot.com/2021/12/adventures-of-mathemat...
The Martians (of which von Neumann is usually the most regarded) were mostly Hungarian jews. It's a point on which some people have mused, so it's easy for the thought to point in that direction when von Neumann is brought up.
I had a girlfriend once who joked that Elon Musk was an alien and needs help developing the technology to get home.
Please do NOT disrespect Leo Szilard and von Neumann by comparing their greatness to a lowly scammer
In other words, if you don't have a dog, you're gay. (If you know the comic)
Whether some people have really superior intellects is completely irrelevant for the rest of the humans unless they distribute to the others some useful products of their intellect.
Von Neumann is one of the hundreds of people from the past who have left a priceless intellectual heritage to me and to the remainder of the mankind, so I am indebted and grateful to them.
I have no reason to feel any debt or gratitude to any of the employees of OpenAI or Anthropic.
Jane Street has published a few useful articles, so I have some gratitude towards them, but none of those was even remotely similar in importance to any page written by von Neumann.
It raises questions like, is it even possible to work for a company while getting credit for world-changing results?
And it implies that at any point in time, there might be thousands of Neumanns in the world, and that initial conditions matter a lot more than ability.