Freeman Dyson’s Quantum Odyssey

In the fall semester of 1947, a brilliant young British mathematician arrived at Cornell University to begin a yearlong fellowship paid by the British Commonwealth.  Freeman Dyson (1923 –) had received an undergraduate degree in mathematics from Cambridge University and was considered to be one of their brightest graduates.  With strong recommendations, he arrived to work with Hans Bethe on quantum electrodynamics.  He made rapid progress on a relativistic model of the Lamb shift, inadvertently intimidating many of his fellow graduate students with his mathematical prowess.  On the other hand, someone who intimidated him, was Richard Feynman.

Initially, Dyson considered Feynman to be a bit of a buffoon and slacker, but he started to notice that Feynman could calculate QED problems in a few lines that took him pages.

Freeman Dyson at Princeton in 1972.

I think like most science/geek types, my first introduction to the unfettered mind of Freeman Dyson was through the science fiction novel Ringworld by Larry Niven. The Dyson ring, or Dyson sphere, was conceived by Dyson when he was thinking about the ultimate fate of civilizations and their increasing need for energy. The greatest source of energy on a stellar scale is of course a star, and Dyson envisioned an advanced civilization capturing all that emitted stellar energy by building a solar collector with a radius the size of a planetary orbit. He published the paper “Search for Artificial Stellar Sources of Infra-Red Radiation” in the prestigious magazine Science in 1960. The practicality of such a scheme has to be seriously questioned, but it is a classic example of how easily he thinks outside the box, taking simple principles and extrapolating them to extreme consequences until the box looks like a speck of dust. I got a first-hand chance to see his way of thinking when he gave a physics colloquium at Cornell University in 1980 when I was an undergraduate there. Hans Bethe still had his office at that time in the Newman laboratory. I remember walking by and looking into his office getting a glance of him editing a paper at his desk. The topic of Dyson’s talk was the fate of life in the long-term evolution of the universe. His arguments were so simple they could not be refuted, yet the consequences for the way life would need to evolve in extreme time was unimaginable … it was a bazaar and mind blowing experience for me as an undergrad … and and example of the strange worlds that can be imagined through simple physics principles.

Initially, as Dyson settled into his life at Cornell under Bethe, he considered Feynman to be a bit of a buffoon and slacker, but he started to notice that Feynman could calculate QED problems in a few lines that took him pages.  Dyson paid closer attention to Feynman, eventually spending more of his time with him than Bethe, and realized that Feynman had invented an entirely new way of calculating quantum effects that used cartoons as a form of book keeping to reduce the complexity of many calculations.  Dyson still did not fully understand how Feynman was doing it, but knew that Feynman’s approach was giving all the right answers.  Around that time, he also began to read about Schwinger’s field-theory approach to QED, following Schwinger’s approach as far as he could, but always coming away with the feeling that it was too complicated and required too much math—even for him! 

Road Trip Across America

That summer, Dyson had time to explore America for the first time because Bethe had gone on an extended trip to Europe.  It turned out that Feynman was driving his car to New Mexico to patch things up with an old flame from his Los Alamos days, so Dyson was happy to tag along.  For days, as they drove across the US, they talked about life and physics and QED.  Dyson had Feynman all to himself and began to see daylight in Feynman’s approach, and to understand that it might be consistent with Schwinger’s and Tomonaga’s field theory approach.  After leaving Feynman in New Mexico, he travelled to the University of Michigan where Schwinger gave a short course on QED, and he was able to dig deeper, talking with him frequently between lectures. 

At the end of the summer, it had been arranged that he would spend the second year of his fellowship at the Institute for Advanced Study in Princeton where Oppenheimer was the new head.  As a final lark before beginning that new phase of his studies he spent a week at Berkeley.  The visit there was uneventful, and he did not find the same kind of open camaraderie that he had found with Bethe in the Newman Laboratory at Cornell, but it left him time to think.  And the more he thought about Schwinger and Feynman, the more convinced he became that the two were equivalent.  On the long bus ride back east from Berkeley, as he half dozed and half looked out the window, he had an epiphany.  He saw all at once how to draw the map from one to the other.  What was more, he realized that many of Feynman’s techniques were much simpler than Schwinger’s, which would significantly simplify lengthy calculations.  By the time he arrived in Chicago, he was ready to write it all down, and by the time he arrived in Princeton, he was ready to publish.  It took him only a few weeks to do it, working with an intensity that he had never experienced before.  When he was done, he sent the paper off to the Physical Review[1].

Dyson knew that he had achieved something significant even though he was essentially just a second-year graduate student, at least from the point of view of the American post-graduate system.  Cambridge was a little different, and Dyson’s degree there was more than the standard bachelor’s degree here.  Nonetheless, he was now under the auspices of the Institute for Advanced Study, where Einstein had his office, and he had sent off an unsupervised manuscript for publication without any imprimatur from the powers at be.  The specific power that mattered most was Oppenheimer, who arrived a few days after Dyson had submitted his manuscript.  When he greeted Oppenheimer, he was excited and pleased to hand him a copy.  Oppenheimer, on the other hand, was neither excited nor pleased to receive it.  Oppenheimer had formed a particularly bad opinion of Feynman’s form of QED at the conference held in the Poconos (to read about Feynman’s disaster at the Poconos conference, see my blog) half-a-year earlier and did not think that this brash young grad student could save it.  Dyson, on his part, was taken aback.  No one who has ever met Dyson would ever call him brash, but in this case he fought for a higher cause, writing a bold memo to Oppenheimer—that terrifying giant of a personality—outlining the importance of the Feynman theory.

Battle for the Heart of Quantum Field Theory 

Oppenheimer decided to give Dyson a chance, and arranged for a series of seminars where Dyson could present the story to the assembled theory group at the Institute, but Dyson could make little headway.  Every time he began to make progress, Oppenheimer would bring it crashing to a halt with scathing questions and criticisms.  This went on for weeks, until Bethe visited from Cornell.  Bethe by then was working with the Feynman formalism himself.  As Bethe lectured in front of Oppenheimer, he seeded his talk with statements such as “surely they had all seen this from Dyson”, and Dyson took the opportunity to pipe up that he had not been allowed to get that far.  After Bethe left, Oppenheimer relented, arranging for Dyson to give three seminars in one week.  The seminars each went on for hours, but finally Dyson got to the end of it.  The audience shuffled out of the seminar room with no energy left for discussions or arguments.  Later that day, Dyson found a note in his box from Oppenheimer saying “Nolo Contendre”—Dyson had won!

With that victory under his belt, Dyson was in a position to communicate the new methods to a small army of postdocs at the Institute, supervising their progress on many outstanding problems in quantum electrodynamics that had resisted calculations using the complicated Schwinger-Tomonaga theory.  Feynman, by this time, had finally published two substantial papers on his approach[2], which added to the foundation that Dyson was building at Princeton.  Although Feynman continued to work for a year or two on QED problems, the center of gravity for these problems shifted solidly to the Institute for Advanced Study and to Dyson.  The army of postdocs that Dyson supervised helped establish the use of Feynman diagrams in QED, calculating ever higher-order corrections to electromagnetic interactions.  These same postdocs were among the first batch of wartime-trained theorists to move into faculty positions across the US, bringing the method of Feynman diagrams with them, adding to the rapid dissemination of Feynman diagrams into many aspects of theoretical physics that extend far beyond QED [3].

As a graduate student at Berkeley in the 1980’s I ran across a very simple-looking equation called “the Dyson equation” in our graduate textbook on relativistic quantum mechanics by Sakurai. The Dyson equation is the extraordinarily simple expression of an infinite series of Feynman diagrams that describes how an electron interacts with itself through the emission of virtual photons that link to virtual electron-positron pairs. This process leads to the propagator Green’s function for the electron and is the starting point for including the simple electron in more complex particle interactions.

The Dyson equation for the single-electron Green’s function represented as an infinite series of Feynman diagrams.

I had no feel for the use of the Dyson equation, barely limping through relativistic quantum mechanics, until a few years later when I was working at Lawrence Berkeley Lab with Mirek Hamera, a visiting scientist from Warwaw Poland who introduced me to the Haldane-Anderson model that applied to a project I was working on for my PhD. Using the theory, with Dyson’s equation at its heart, we were able to show that tightly bound electrons on transition-metal impurities in semiconductors acted as internal reference levels that allowed us to measure internal properties of semiconductors that had never been accessible before. A few years later, I used Dyson’s equation again when I was working on small precipitates of arsenic in the semiconductor GaAs, using the theory to describe an accordion-like ladder of electron states that can occur within the semiconductor bandgap when a nano-sphere takes on multiple charges [4].

The Coulomb ladder of deep energy states of a nano-sphere in GaAs calculated using self-energy principles first studied by Dyson.

I last saw Dyson when he gave the Hubert James Memorial Lecture at Purdue University in 1996. The title of his talk was “How the Dinosaurs Might Have Been Saved: Detection and Deflection of Earth-Impacting Bodies”. As always, his talk was wild and wide ranging, using the simplest possible physics to derive the most dire consequences of our continued existence on this planet.


[1] Dyson, F. J. (1949). “THE RADIATION THEORIES OF TOMONAGA, SCHWINGER, AND FEYNMAN.” Physical Review 75(3): 486-502.

[2] Feynman, R. P. (1949). “THE THEORY OF POSITRONS.” Physical Review 76(6): 749-759.  Feynman, R. P. (1949). “SPACE-TIME APPROACH TO QUANTUM ELECTRODYNAMICS.” Physical Review 76(6): 769-789.

[3] Kaiser, D., K. Ito and K. Hall (2004). “Spreading the tools of theory: Feynman diagrams in the USA, Japan, and the Soviet Union.” Social Studies of Science 34(6): 879-922.

[4] Nolte, D. D. (1998). “Mesoscopic Point-like Defects in Semiconductors.” Phys. Rev. B58(12): pg. 7994

Feynman and the Dawn of QED

In the years immediately following the Japanese surrender at the end of WWII, before the horror and paranoia of global nuclear war had time to sink into the psyche of the nation, atomic scientists were the rock stars of their times.  Not only had they helped end the war with a decisive stroke, they were also the geniuses who were going to lead the US and the World into a bright new future of possibilities.  To help kick off the new era, the powers in Washington proposed to hold a US meeting modeled on the European Solvay Congresses.  The invitees would be a select group of the leading atomic physicists: invitation only!  The conference was held at the Rams Head Inn on Shelter Island, at the far end of Long Island, New York in June of 1947.  The two dozen scientists arrived in a motorcade with police escort and national press coverage.  Richard Feynman was one of the select invitees, although he had done little fundamental work beyond his doctoral thesis with Wheeler.  This would be his first real chance to expound on his path integral formulation of quantum mechanics.  It was also his first conference where he was with all the big guns.  Oppenheimer and Bethe were there as well as Wheeler and Kramers, von Neumann and Pauling.  It was an august crowd and auspicious occasion.

Shelter Island and the Foundations of Quantum Mechanics

            The topic that had been selected for the conference was Foundations of Quantum Mechanics, which at that time meant quantum electrodynamics, known as QED, a theory that was at the forefront of theoretical physics, but mired in theoretical difficulties.  Specifically, it was waist deep in infinities that cropped up in calculations that went beyond the lowest order.  The theorists could do back-of-the-envelope calculations with ease and arrive quickly at rough numbers that closely matched experiment, but as soon as they tried to be more accurate, results diverged, mainly because of the self-energy of the electron, which was the problem that Wheeler and Feynman had started on at the beginning of his doctoral studies [1].  As long as experiments had only limited resolution, the calculations were often good enough.  But at the Shelter Island conference, Willis Lamb, a theorist-turned-experimentalist from Columbia University, announced the highest resolution atomic spectroscopy of atomic hydrogen ever attained, and there was a deep surprise in the experimental results.

An obvious photo-op at Shelter Island with, left to right: W. Lamb, Abraham Pais, John Wheeler (holding paper), Richard P. Feynman (holding pen), Herman Feschbach and Julian Schwinger.

            Hydrogen, of course, is the simplest of all atoms.  This was the atom that launched Bohr’s model, inspired Heisenberg’s matrix mechanics and proved Schrödinger’s wave mechanics.  Deviations from the classical Bohr levels, measured experimentally, were the testing grounds for Dirac’s relativistic quantum theory that had enjoyed unparalleled success until Lamb’s presentation at Shelter Island.  Lamb showed there was an exceedingly small energy splitting of about 200 parts in a billion that amounted to a wavelength of 28 cm in the microwave region of the electromagnetic spectrum.  This splitting was not predicted, nor could it be described, by the formerly successful relativistic Dirac theory of the electron. 

            The audience was abuzz with excitement.  Here was a very accurate measurement that stood ready for the theorists to test their theories on.  In the discussions, Oppenheimer guessed that the splitting was likely caused by electromagnetic interactions related to the self energy of the electron.  Victor Weisskopf of MIT with Julian Schwinger of Harvard suggested that, although the total energy calculations of each level might be infinite,  the difference in energy DE should be finite.  After all, in spectroscopy it is only the energy difference that is measured experimentally.  Absolute energies are not accessible directly to experiment.  The trick was how to subtract one infinity from another in a consistent way to get a finite answer.  Many of the discussions in the hallways, as well as many of the presentations, revolved around this question.  For instance, Kramers suggested that there should be two masses in the electron theory—one is the observed electron mass seen in experiments, and the second is a type of internal or bare mass of the electron to be used in perturbation calculations. 

            On the train ride up state after the Shelter Island Conference, Hans Bethe took out his pen and a sheaf of paper and started scribbling down ideas about how to use mass renormalization, subtracting infinity from infinity in a precise and consistent way to get finite answers in the QED calculations.  He made surprising progress, and by the time the train pulled into the station at Schenectady he had achieved a finite calculation in reasonable agreement with Lamb’s shift.  Oppenheimer had been right that the Lamb shift was electromagnetic in origin, and the suggestion by Weisskopf and Schwinger that the energy difference would be finite was indeed the correct approach.  Bethe was thrilled with his own progress and quickly wrote up a paper draft and sent a copy in letters to Oppenheimer and Weisskopf [2].  Oppenheimer’s reply was gracious, but Weisskopf initially bristled because he also had tried the calculations after the conference, but had failed where Bethe had succeeded.  On the other hand, both pointed out to Bethe that his calculation was non-relativistic, and that a relativistic calculation was still needed.

When Bethe returned to Cornell, he told Feynman about the success of his calculations but that a relativistic version was still missing. Feynman told him on the spot that he knew how to do it and that he would have it the next day. Feynman’s optimism was based on the new approach to relativistic quantum electrodynamics that he had been developing with the aid of his newly-invented “Feynman Diagrams”. Despite his optimism, he hit a snag that evening as he tried to calculate the self-energy of the electron. When he met with Bethe the next day, they both tried to to reconcile the calculations with Feynman’s new approach, but they failed to find a path through the calculations that made sense. Somewhat miffed, because he knew that his approach should work, Feynman got down to work in a way that he had usually avoided (he had always liked finding the “easy” path through tough problems). Over several intense months, he began to see how it all would work out.

           At the same time that Feynman was making progress on his work, word arrived at Cornell of progress being made by Julian Schwinger at Harvard.  Schwinger was a mathematical prodigy like Feynman, and also like Feynman had grown up in New York city, but they came from very different neighborhoods and had very different styles.  Schwinger was a formalist who pursued everything with precision and mathematical rigor.  He lectured calmly without notes in flawless presentations.  Feynman, on the other hand, did his physics by feel.  He made intuitive guesses and checked afterwards if they were right, testing ideas through trial and error.  His lectures ranged widely, with great energy, without structure, following wherever the ideas might lead.  This difference in approach and style between Schwinger and Feynman would have embarrassing consequences at the upcoming sequel to the Shelter Island conference that was to be held in late March 1948 at a resort in the Pocono Mountains in Pennsylvania.

The Conference in the Poconos

           The Pocono conference was poised to be for the theorists Schwinger and Feynman what the Shelter Island had been for the experimentalists Rabi and Lamb—a chance to drop bombshells.  There was a palpable buzz leading up to the conference with advance word coming from Schwinger about his successful calculation of the g-factor of the electron and the Lamb shift.  In addition to the attendees who had been at Shelter Island, the Pocono conference was attended by Bohr and Dirac—two of the giants who had invented quantum mechanics.  Schwinger began his presentation first.  He had developed a rigorous mathematical method to remove the infinities from QED, enabling him to make detailed calculations of the QED corrections—a significant achievement—but the method was terribly complicated and tedious.  His presentation went on for many hours in his carefully crafted style, without notes, delivered like a speech.  Even so, the audience grew restless, and whenever Schwinger tried to justify his work on physical grounds, Bohr would speak up, and arguments among the attendees would ensue, after which Schwinger would say that all would become clear at the end.  Finally, he came to the end, where only Fermi and Bethe had followed him.  The rest of the audience was in a daze.

            Feynman was nervous.  It had seemed to him that Schwinger’s talk had gone badly, despite Schwinger’s careful preparation.  Furthermore, the audience was spent and not in a mood to hear anything challenging.  Bethe suggested that if Feynman stuck to the math instead of the physics, then the audience might not interrupt so much.  So Feynman restructured his talk in the short break before he was to begin.  Unfortunately, Feynman’s strength was in physical intuition, and although he was no slouch at math, he was guided by visualization and by trial and error.  Many of the steps in his method worked (he knew this because they gave the correct answers and because he could “feel” they were correct), but he did not have all the mathematical justifications.  What he did have was a completely new way of thinking about quantum electromagnetic interactions and a new way of making calculations that were far simpler and faster than Schwinger’s.  The challenge was that he relied on space-time graphs in which “unphysical” things were allowed to occur, and in fact were required to occur, as part of the sum over many histories of his path integrals.  For instance, a key element in the approach was allowing electrons to travel backwards in time as positrons.  In addition, a process in which the electron and positron annihilate into a single photon, and then the photon decays into an electron-positron pair, is not allowed by mass and energy conservation, but this is a possible history that must add to the sum.  As long as the time between the photon emission and decay is short enough to satisfy Heisenberg’s uncertainty principle, there is no violation of physics.

Feynman’s first published “Feynman Diagram” in the Physical Review (1948) [3] (Photograph reprinted from “Galileo Unbound” (D. Nolte, Oxford University Press, 2018)

            None of this was familiar to the audience, and the talk quickly derailed.  Dirac pestered him with questions that he tried to deflect, but Dirac persisted like a raven pecking at dead meat.  A question was raised about the Pauli exclusion principle, about whether an orbital could have three electrons instead of the required two, and Feynman said that it could (all histories were possible and had to be summed over), an answer that dismayed the audience.  Finally, as Feynman was drawing another of his space-time graphs showing electrons as lines, Bohr rose to his feet and asked whether Feynman had forgotten Heisenberg’s uncertainty principle that made it impossible to even talk about an electron trajectory.  It was hopeless.  Bohr had not understood that the diagrams were a shorthand notation not to be taken literally.  The audience gave up and so did Feynman.  The talk just fizzled out.  It was a disaster.

           At the close of the Pocono conference, Schwinger was the hero, and his version of QED appeared to be the right approach [4].  Oppenheimer, the reigning king of physics, former head of the successful Manhattan Project and newly selected to head the prestigious Institute for Advanced Study at Princeton, had been thoroughly impressed by Schwinger and thoroughly disappointed by Feynman.  When Oppenheimer returned to Princeton, a letter was waiting for him in the mail from a colleague he knew in Japan by the name of Sin-Itiro Tomonaga [5].  In the letter, Tomonaga described work he had completed, unbeknownst to anyone in the US or Europe, on a renormalized QED.  His results and approach were similar to Schwinger’s but had been accomplished independently in a virtual vacuum that surrounded Japan after the end of the war.  His results cemented the Schwinger-Tomonaga approach to QED, further elevating them above the odd-ball Feynman scratchings.  Oppenheimer immediately circulated the news of Tomonaga’s success to all the attendees of the Pocono conference.  It appeared that Feynman was destined to be a footnote, but the prevailing winds were about to change as Feynman retreated to Cornell. In defeat, Feynman found the motivation to establish his simplified yet powerful version of quantum electrodynamics. He published his approach in 1948, a method that surpassed Schwinger and Tomonaga in conceptual clarity and ease of calculation. This work was to catapult Feynman to the pinnacles of fame, becoming the physicist next to Einstein whose name was most recognizable, in that later half of the twentieth century, to the man in the street (helped by a series of books that mythologized his exploits [6]).



For more on the history of Feynman and quantum mechanics, buy Galileo Unbound from Oxford Press:


References


[1] See Chapter 8 “On the Quantum Footpath”, Galileo Unbound (Oxford, 2018)

[2] Schweber, S. S. QED and the men who made it : Dyson, Feynman, Schwinger, and Tomonaga. Princeton, N.J. :, Princeton University Press. (1994)

[3] Feynman, R. P. “Space-time Approach to Quantum Electrodynamics.” Physical Review 76(6): 769-789. (1949)

[4] Schwinger, J. “ON QUANTUM-ELECTRODYNAMICS AND THE MAGNETIC MOMENT OF THE ELECTRON.” Physical Review 73(4): 416-417. (1948)

[5] Tomonaga, S. “ON INFINITE FIELD REACTIONS IN QUANTUM FIELD THEORY.” Physical Review 74(2): 224-225. (1948)

[6] Surely You’re Joking, Mr. Feynman!: Adventures of a Curious Character, Richard Feynman, Ralph Leighton (contributor), Edward Hutchings (editor), 1985, W W Norton,