Fermilab feature

One minute with Bryan Ramson, neutrino physicist

In addition to researching neutrino physics, Bryan Ramson is the co-director of Fermilab’s Saturday Morning Physics program. Photo: Edward C. Jones

How long have you been at Fermilab?

I first came here as a graduate student in May of 2013. Officially, I’ve been at Fermilab since May of 2018 as a postdoc.

What is your role here?

I am a jack of all trades — I do a little bit of everything. My stated job goals are to support the DUNE and NOvA neutrino experiments. Practically, this means collaborating in the collection, analysis, and publication of data from both experiments.

What excites you about working on these projects?

What interests me most about DUNE and NOvA is that there are applications from my graduate-level work on nuclear physics to high-energy physics. I am super excited about the beyond-the-Standard-Model physics that can be investigated with neutrino oscillations, like the ratio of matter to antimatter in the universe. I think Fermilab will be the center of a sort of “neutrinoland” for the next 10 years, at least, so I’m really happy to be in the mix where everything’s going on.

How did you originally become interested in physics?

In high school, I took a physics course, and I did terribly. I got a C. Before then, I thought I was going to be a computer programmer because I like structured ways of thinking about problems. Whereas thinking about algorithms in code allows you to solve problems within the context of computers, learning about physics allows you to solve problems in the context of the universe. Once I figured out that there was this powerful mode of thought, I was like, “Yeah, I’ve got to do this.”

What do you enjoy most about working on Saturday Morning Physics, the lab’s lecture series for high school students?

Some of the questions that are being answered in Saturday Morning Physics are questions I asked when I was taking my first physics course: What is fire? Does light have mass? My favorite aspect of Saturday Morning Physics is being able to interact with young minds, being able to chat with folks who are just learning this stuff and try to explain it to them and satisfy their curiosity.

I’m really excited about trying to expand Saturday Morning Physics to more sites in Chicago. That means talking to schools, like those in Chicago’s West Side and South Side, that are typically frequented by underrepresented identities, and trying to see if there are any kids there who might be interested in doing this sort of program.

What do you like to do when you’re not at work?

I run a lot. I have logged over 100 five-mile runs since COVID-19 started. It’s like a moving meditation. I get in my mind and see how I’m feeling and feel out my body, and I also turn over really difficult problems while I’m running.

I’m also a car buff. I like working on my cars, driving them, going to car shows. And I like to read. I’m in numerous book clubs.

I like to cook a lot. I’m from the South, and I have a rich family history of cooking — Cajun food, French food, a lot of stuff. I’ve actually made duck à l’orange from scratch. I make gumbo, I make red beans and rice, I fry fish. I do all that stuff.

Fermilab neutrino research is supported by the Department of Energy Office of Science.

Fermilab is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit science.energy.gov.

Only a handful of particle accelerators around the world can produce proton beams intense enough for use in neutrino experiments. Europe and Japan each has an accelerator chain. So does the U.S. Department of Energy’s Fermi National Accelerator Laboratory.

Fermilab, however, is the only laboratory that produces protons at energies suitable for both low- and high-energy neutrino experiments. In fact, it produces the most intense neutrino beam in the world. This is but one example of Fermilab’s accelerator prowess. The laboratory’s collaborations with nearby universities and research laboratories have established the northern Illinois region as a leader in multiple areas of particle accelerator science and technology.

“In Chicago we have a very strong academic environment, not only in physics, in fundamental science, but also in applied science as well as engineering,” said Sergei Nagaitsev, head of Fermilab’s accelerator science programs and a University of Chicago faculty member.

This has led to accelerator research collaborations with the Illinois Institute of Technology, Northern Illinois University, Northwestern University and the University of Chicago.

“The combined accelerator R&D portfolio of Fermilab and collaborating Illinois institutions covers nearly every facet of particle acceleration, from basic principles to applications of accelerators in industry,” said Fermilab Chief Technology Officer Sergey Belomestnykh.

A spectrum of discovery and invention

Together with its northern Illinois partners, Fermilab grapples with multiple scientific and engineering challenges that are vitally important to improving accelerator beams and experimental outcomes.

“It’s hard to point at where science ends and technology begins,” Nagaitsev said. “There is a spectrum of discovery on one side versus invention on the other side. Both require creativity from our scientists and engineers.”

Researchers at Fermilab, Illinois Institute of Technology, Northern Illinois University and the University of Chicago all use IOTA, the Integrable Optics Test Accelerator, a major component of the lab’s accelerator-science enterprise and one of only a few accelerators in the world dedicated to studying the physics of beams. Photo: Giulio Stancari, Fermilab

The physics of beams

The challenges on the accelerator science side relate to the physics of the beam itself.

Scientists work to produce beams of higher quality, which is connected to properties such as beam size and spread; achieve better measurements and control of beams down to the level of individual particles; predict beam behavior with better fidelity using computer simulations; and produce beams of higher intensity.

“Our particle physics experiments, especially the neutrino experiments, are hungry for intense proton beams delivered to the target,” Nagaitsev said.

To investigate problems in beam physics, Fermilab operates the Integrable Optics Test Accelerator, called IOTA, a major component of the lab’s accelerator-science enterprise and one of only a few accelerators in the world dedicated to studying the physics of beams. Researchers at Fermilab, IIT, NIU and the University of Chicago all use IOTA. Their work includes studies of electron and proton beams in rings, and their results will directly affect the Fermilab high-intensity proton rings used for neutrino and other particle physics research. Nagaitsev and his colleagues will also soon aim to demonstrate a new beam cooling technique called optical stochastic cooling — a novel way to improve the beam’s quality.

Science and technology of superconductivity

Science and technology of superconductivity is critical for building modern particle accelerators. Superconducting radio-frequency cavities – structures that impart energy to a particle beam – provide high levels of acceleration, making it more efficient, while high-field superconducting magnets allow tighter bending of particle trajectories, thus reducing the footprint of future accelerators. Members of Fermilab’s Applied Physics and Superconducting Technology Division are at the forefront of this field.

“It’s a cool blend of basic and applied science. We’re applying our understanding of the principles of materials science to giant particle-accelerating machines,” Belomestnykh said. “In turn, these machines enable us to scrutinize matter’s fundamental constituents.”

In July, Fermilab set the new world record for field strength for a superconducting accelerator dipole magnet – 14.5 teslas. And it is ambitiously setting its sights on developing magnets that can generate a field of 20 teslas — about 2,000 times higher than a strong refrigerator magnet.

Among achievements in superconducting radio-frequency technology, Fermilab researchers have discovered ways to significantly boost the cavity’s efficiency and accelerating field, both of which are crucial for future particle accelerators. And it turns out that these cavities, developed for accelerators, find applications in somewhat unexpected areas. They are leading candidates for scalable quantum computing technology thanks to the exceptionally long times they can maintain energy. The same technology has proven to be very useful in a search for elusive dark matter particles, such as dark photons.

Here, too, Fermilab collaborates with regional partners. For example, scientists at the Center for Applied Physics and Superconducting Technologies, known as CAPST, a collaboration between Fermilab and nearby Northwestern University, are exploring the upper limits of superconductivity to design and build more powerful and efficient accelerator components.

“The importance of superconductivity research for particle accelerators can not be overstated,” said Fermilab Deputy Chief Technology Officer and CAPST Co-Director Anna Grassellino. “We’re making great strides in this area in northern Illinois.”

Scientists at Fermilab are studying superconductivity to design and build more powerful and efficient accelerator components. Several Fermilab and Northwestern University scientists are part of Center for Applied Physics and Superconducting Technologies to explore the upper limits of superconductivity. Photo: Reidar Hahn, Fermilab

Targets and beams

There’s also the science and technology of targetry: engineering materials to withstand the powerful particle beams smashing into them.

“Suppose we resolve the challenge of making beams very intense. Then you put them on a target and the target melts,” Nagaitsev said. “There has to be continuing research on how to make the targets more robust so that when the science delivers high-intensity beams, the target can take it.”

Toward autonomous accelerators

Fermilab scientists are exploring the use of artificial intelligence and machine learning for tuning accelerators, delivering flexible beam patterns and increasing a machine’s uptime. This steady move toward autonomous accelerator operation means that, one day, accelerators could run with little to no human intervention. Researchers are carrying out autonomous-accelerator studies at the Fermilab Science and Technology facility and at Fermilab’s PIP-II Injector Test Facility, a proving ground for the future heart of the lab’s accelerator complex, its PIP-II accelerator.

A number of these studies are being conducted as part of a program led by the University of Chicago.

And in the next five years or so, Fermilab’s accelerator researchers would like to build an electron injector for testing a potential way to do large-scale quantum computing.

“Fermilab has many interesting research plans for both near and far future,” Nagaitsev promised.

Accelerator applications

The use of accelerator technology goes beyond the academic. The world’s more than 30,000 operating particle accelerators also shrink tumors, make better tires, spot suspicious cargo, clean up dirty drinking water and help design drugs.

To facilitate the application of accelerators for societal benefit, Fermilab established the IARC at Fermilab (formerly known as the Illinois Accelerator Research Center), a technology development hub that connects scientists with members of industry. Industry partners are welcome to use the lab’s facilities to try out accelerator-related concepts. For example, IARC’s Accelerator Applications Development and Demonstration Facility, known as A2D2, is a test platform experts can use to evaluate new ideas for electron-beam applications.

“We have a wonderful concentration of accelerator expertise at Fermilab and in northern Illinois, and we’re facilitating cross-pollination with people who are innovating accelerator-based technologies for our everyday lives,” said Tim Meyer, head of Fermilab Technology Engagements. “By putting our heads together, by sharing our capabilities and facilities, we’re discovering uses for particle accelerators we wouldn’t otherwise.”

One of IARC’s goals is to make the technologies developed for science more widely available for commercial applications. For example, experts at IARC are developing a compact, mobile, superconducting particle accelerator that would fit on a truck for a variety of applications. To help realize that goal, they’ve also developed a new cooling method to reduce the bulk of the traditional infrastructure needed to cool it to cryogenic temperatures.

IARC at Fermilab is a technology development hub that connects scientists with members of industry. Photo: Reidar Hahn, Fermilab

Accelerating the workforce

The potential of accelerators is boundless, so accelerator research is a strong draw for early-career scientists. Perhaps this explains why Mike Syphers, an NIU research professor of physics, has yet to see a saturated demand for accelerator scientists, even as large projects have come and gone.

The U.S. Particle Accelerator School, he noted, attracts near-record-setting numbers of students every year. Fermilab hosts and manages this national, graduate-level program, which provides training and workforce development in the science and technology of charged-particle accelerators and associated systems.

Multiple training programs will help develop young scientists to help realize the field’s future plans.

The Joint University-Fermilab Doctoral Program in Accelerator Physics and Technology, for example, has graduated 53 Ph.D. students since its establishment in 1985. Three more are currently in the pipeline.

Students study at the U.S. Particle Accelerator School hosted by Northern Illinois University in 2017. USPAS is just one particle accelerator science program in which Fermilab participates. Others include The Joint University-Fermilab Doctoral Program in Accelerator Physics and Technology and the Chicagoland Accelerator Science Traineeship, launched by NIU and IIT. Photo: USPAS

A related effort, launched by NIU and IIT and funded with $1.9 million from the U.S. Department of Energy, is the Chicagoland Accelerator Science Traineeship. The traineeships will provide up to two years of funding for graduate students at NIU and IIT to prepare them for careers in accelerator science and technology. Fermilab also participates in two other similar programs: the Accelerator Science and Engineering Traineeship at Michigan State University and the Ernest Courant Traineeship in Accelerator Science & Engineering at Stony Brook University.

Two Fermilab internships attract students interested in particle accelerator physics and technology to the lab: The Lee Teng Internship is a joint program between Fermilab and neighboring Argonne National Laboratory for undergraduate students. The Helen Edwards Summer Internship brings European physics and engineering students to Fermilab.

“The field has continued to grow as the use of particle accelerators has expanded beyond national laboratories and pure scientific research,” Syphers said. “Various applications of accelerators and medical uses have driven further demand for people with knowledge of these devices.”

Building acceleration

Fermilab stands alone as a laboratory that can deliver the most intense beam of neutrinos in the world and accelerate beams for low- and high-energy neutrino experiments. This is thanks to a major accelerator upgrade currently underway at the lab: the Proton Improvement Plan-II. The heart of PIP-II will be the construction of a 215-meter-long superconducting accelerator that can generate powerful proton beams for the lab’s experiments.

Again, partnership is key: Argonne National Laboratory — a 30-mile jaunt from Fermilab — pursues accelerator R&D and serves as one of Fermilab’s U.S. partners in PIP-II. And Fermilab collaborates with Argonne accelerator research groups at the Advanced Photon Source, the Argonne Tandem Linac Accelerator System and the Argonne Wakefield Accelerator Facility.

With PIP-II scheduled to become fully operational in the late 2020s, NIU’s Syphers is already helping to develop plans for Fermilab’s next accelerator upgrade path.

“We have to start thinking now about what the next step would be beyond PIP-II because it would take years to plan,” Syphers said.

Fermilab and partners, including Argonne National Laboratory and Northern Illinois University, are designing and building the upcoming PIP-II accelerator, scheduled to become fully operational in the late 2020s. Photo: Reidar Hahn, Fermilab

While prototyping and testing of PIP-II components take place, researchers already are discussing ideas for improvements beyond the new machine, for example, doubling the number of protons Fermilab’s accelerator chain would send to experiments.

Intense proton beams are necessary to produce the neutrinos for the international Deep Underground Neutrino Experiment, or DUNE, hosted by Fermilab, and its Long-Baseline Neutrino Facility. By studying neutrinos, the most abundant matter particles in the universe, DUNE discoveries could revolutionize cosmological research.

PIP-II boasts collaborators beyond Illinois borders: It is the only accelerator project in the U.S. that receives major international contributions.

Once operational, PIP-II will dramatically boost Fermilab’s proton production for DUNE and future research programs.

“We are always innovating technologies to help design and build the leanest and most powerful machines we can for discovery,” Belomestnykh said. “In sharing those innovations with our global partners, we’re helping advance accelerator technology not just in Illinois, but around the world.”

For example, together with other DOE national laboratories, Fermilab leads the U.S. effort to design, build and test next-generation focusing magnets for upgrading the Large Hadron Collider at CERN and is building superconducting cryomodules for the Linac Coherence Light Source-II project, a revolutionary X-ray laser under construction at SLAC National Accelerator Laboratory.

“Accelerator science and technology is one Fermilab’s core competencies. Together with our regional partners, we are striving to make Chicagoland the next Silicon Valley for particle accelerators and their applications,” Nagaitsev said. “With the unparalleled wealth of accelerator knowledge and activity here in one of the tech hubs of the country, we’re very well positioned to do just that.”

Fermilab accelerator R&D is supported by the DOE Office of Science.

Fermilab is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit science.energy.gov.

Machine learning algorithms can beat the world’s hardest video games in minutes and solve complex equations faster than the collective efforts of generations of physicists. But the conventional algorithms still struggle to pick out stop signs on a busy street.

Object identification continues to hamper the field of machine learning — especially when the pictures are multidimensional and complicated, like the ones particle detectors take of collisions in high-energy physics experiments. However, a new class of neural networks is helping these models boost their pattern recognition abilities, and the technology may soon be implemented in particle physics experiments to optimize data analysis.

This summer, Fermilab physicists made an advance in their effort to embed graph neural networks into the experimental systems. Scientist Lindsey Gray updated software that allows these cutting-edge algorithms to be deployed on data from the Large Hadron Collider at CERN. For the first time, these networks will be integrated into particle physics experiments to process detector data directly — opening the flood gates for a major jump in efficiency that will yield more precise insight from current and future detectors.

“What was a week ago just an object of research is now a widely usable tool that could transform our ability to analyze data from particle physics experiments,” Gray said.

The upgraded high-granularity calorimeter — a component of the CMS detector at the Large Hadron Collider — produces complicated images of particles generated from collisions. Researchers are working to implement graph neural networks to optimize the analysis of this data to better identify and characterize particle interactions of interest. Image courtesy of Ziheng Chen, Northwestern University

His work focuses initially on using graph neural networks to analyze data from the CMS experiment at the LHC, one of the collider’s four major particle physics experiments.

Programmers develop neural networks to sift through mountains of data in search for a specific category or quantity — say, a stop sign in a photo of a crowded street.

Normal digital photographs are essentially a giant grid of red, green and blue square pixels. After being trained to recognize what a stop sign looks like, classic neural networks inspect the whole block of pixels to see whether or not the target is present. This method is inefficient, however, since the models have to process lots of irrelevant, obfuscating data.

Computer scientists have developed new classes of neural networks to improve this process, but the algorithms still struggle to identify objects in images that are more complex than just a two-dimensional grid of square pixels.

Take molecules, for example. In order to determine whether or not a chemical is toxic, chemists have to locate certain features like carbon rings and carboxyl groups within a molecule. The photographs of the chemicals taken with X-ray chromatography machines produce 3-D images of bonded atoms, which look slightly different every time they’re viewed.

Since the data are not stored in a square grid, it’s difficult for typical neural networks to learn to identify the toxic compounds. To get around this, chemists have started employing a new set of neural networks: graph neural networks, or GNNs.

“What was a week ago just an object of research is now a widely usable tool that could transform our ability to analyze data from particle physics experiments.” – Lindsey Gray

Unlike these typical neural networks, GNNs are able to tell which pixels are connected to one another even if they’re not in a 2-D grid. By making use of the “edges” between the “nodes” of data (in this case, the bonds between the atoms), these machine learning models can identify desired subjects much more efficiently.

Gray’s vision is to bring these models and their enhanced target identification to streamline data processing for particle collisions.

“With a graph neural net, you can write a significantly better pattern recognition algorithm to be used for something as complex as particle accelerator data because it has the ability to look at relationships between all the data coming in to find the most pertinent parts of that information,” he said.

Gray’s research focuses on implementing GNNs into the CMS detector’s high-granularity calorimeter, or HGCal. CMS takes billions of images of high-energy collisions every second to search for evidence of new particles.

One challenge of the calorimeter is that it collects so much data — enough pictures to fill up 20 million iPhones every second — that a large majority must be thrown away because of limitations in storage space. The HGCal’s trigger systems have to decide in a few millionths of a second which parts of the data are interesting and should be saved. The rest get deleted.

“If you have a neural network that you can optimize to run in a certain amount of time, then you can make those decisions more reliably. You don’t miss things, and you don’t keep things that you don’t really need,” said Kevin Pedro, another Fermilab scientist working with Gray.

The HGCal detectors collect lots of different information at the same time about particle interactions, which produces some very complicated images.

“These data are weirdly shaped, they have random gaps in them, and they’re not even remotely close to a contiguous grid of squares,” Gray said. “That’s where the graphs come in — because they allow you to just skip all of the meaningless stuff.”

The CMS detector at the Large Hadron Collider takes billions of images of high-energy collisions every second to search for evidence of new particles. Graph neural networks expeditiously decide which of these data to keep for further analysis. Photo: CERN

In theory, the GNNs would be trained to analyze the connections between pixels of interest and be able to predict which images should be saved and which can be deleted much more efficiently and accurately. However, because this class of neural net is so new to particle physics, it’s not yet possible to implement them directly into the trigger hardware.

The graph neural network is well-suited to the HGCal in another way: The HGCal’s modules are hexagonal, a geometry that, while not compatible with other types of neural networks, works well with GNNs.

“That’s what makes this particular project a breakthrough,” said Fermilab Chief Information Officer Liz Sexton-Kennedy. “It shows the ingenuity of Kevin and Lindsey: They worked closely to colleagues designing the calorimeter, and they put to use their unique expertise in software to further extend the capabilities of the experiment.”

Gray also managed to write a code that extends the capabilities of PyTorch, a widely used open-source machine learning framework, to allow graph neural network models to be run remotely on devices around the world.

“Prior to this, it was extremely clunky and circuitous to build a model and then deploy it,” Gray said. “Now that it’s functional, you just send off data into the service, it figures out how to best execute it, and then the output gets sent back to you.”

Gray and Pedro said they hope to have the graph neural networks functional by the time the LHC’s Run 3 resumes in 2021. This way, the models can be trained and tested before the collider’s high-luminosity upgrade, whose increased data collection capabilities will make GNNs even more valuable.

Once the networks are up and running in one place, it should be much easier to get them working in other experiments around the lab.

“You can still apply all of the same things we’re learning about graph neural networks in the HGCal to other detectors in other experiments,” Gray said. “The rate at which we’re adopting machine learning in high-energy physics is not even close to saturated yet. People will keep finding more and more ways to apply it.”

Fermilab scientific computing research is supported by the Department of Energy Office of Science.

Fermilab is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit science.energy.gov.