The neutrino, it would seem, has global appeal.
The mysteries surrounding the renegade particle are attracting a worldwide science community to the future DUNE experiment. DUNE — the Deep Underground Neutrino Experiment — is a multinational effort to address the biggest questions in neutrino physics. More than 950 researchers from 30 countries have joined the DUNE collaboration, and both numbers are trending upward: Back in 2015, the collaboration comprised about 560 scientists and engineers from 23 countries.
It’s currently the largest particle physics project being undertaken anywhere in the world since the Large Hadron Collider at the European laboratory CERN. Modeled after CERN’s ATLAS and CMS experiments, the DUNE collaboration is an international organization. The experiment will be hosted in the United States by Fermi National Accelerator Laboratory.
The latest countries to join DUNE include Chile and Peru. The most recent new institutes to join DUNE come from Colombia, the UK and the US.
“It’s the excitement that’s being generated by the science,” said DUNE spokesperson Mark Thomson, a professor of physics at the University of Cambridge in the UK. “Everybody recognizes the DUNE program as strong, and the technology is interesting as well.”
It’s a tall order that will take a global village to fill, and researchers worldwide are currently building or signing up to build the experiment, taking advantage of DUNE’s broad scientific and geographic scope.
“We’re a country that does a lot of theoretical physics but not a lot of experimental physics, because it’s not so cheap to have a particle physics experiment here,” said Brazilian DUNE collaborator Ana Amelia Machado, a collaborating scientist at the University of Campinas and a professor at the Federal University of ABC in the ABC region of Brazil. “So we participate in big collaborations like DUNE, which is attractive because it brings together theorists and experimentalists.”
Machado is currently working on a device named Arapuca, which she describes as a photon catcher that could detect particle phenomena that DUNE is interested in, such as supernova neutrino interactions. She’s also working to connect more Latin American universities with DUNE, such as the University Antonio Nariño.
On the opposite side of the world, scientists and engineers from India are working on upgrading the high-intensity proton accelerator at Fermilab, which will provide the world’s most intense neutrino beam to the DUNE experiment. Building on the past collaborations with other Fermilab experiments, the Indian scientists are also proposing to build the near detector for the DUNE experiment. Not only are India’s contributions important for DUNE’s success, they’re also potential seeds for India’s own future particle physics programs.
More than 950 researchers from 30 countries have joined DUNE. Collaborators are developing new technologies for DUNE’s particle detectors, giant instruments that will help capture the notoriously elusive neutrino.
“It’s exciting because it’s something that India’s doing for the first time. India has never built a full detector for any particle physics experiment in the world,” said Bipul Bhuyan, a DUNE collaborator at the Indian Institution of Technology Guwahati. “Building a particle detector for an international science experiment like DUNE will bring considerable visibility to Indian institutions and better industry-academia partnership in developing advanced detector technology. It will help us to build our own future experimental facility in India as well.”
DUNE’s two particle detectors will be separated by 800 miles: a two-story detector on the Fermilab site in northern Illinois and a far larger detector to be situated nearly a mile underground in South Dakota at the Sanford Underground Research Facility. Fermilab particle accelerators, part of the Long-Baseline Neutrino Facility for DUNE, will create an intense beam of neutrinos that will pass first through the near detector and then continue straight through Earth to the far detector.
Scientists will compare measurements from the two detectors to examine how the neutrinos morphed from one of three types into another over their interstate journey. The far detector will contain 70,000 tons of cryogenic liquid argon to capture a tiny fraction of the neutrinos that pass through it. DUNE scientists are currently working on ways to improve liquid-argon detection techniques.
The near detector, which is close to the neutrino beam source and so sees the beam where it is most intense, will be packed with all kinds of components so that scientists can get as many readings as they can on the tricky particles: their energy, their momentum, the likelihood that they’ll interact with the detector material.
“This is an opportunity for new collaborators, where new international groups can get involved in a big way,” said Colorado State University professor Bob Wilson, chair of the DUNE Institutional Board. “There’s a broad scope of physics topics that will come out of the near detector.”
“There aren’t that many new, big experiments out there,” Thomson said. “We have 950 collaborators now, and we’re likely to hit 1,000 in the coming months.”
That will be a notable milestone for the collaboration, one that follows another sign of its international strength: Late last month, for the first time, DUNE held its collaboration meeting away from its home base of Fermilab. CERN served as the meeting host.
DUNE is supported by funding agencies from many countries, including the Department of Energy Office of Science in the United States.
“We have people from different countries that haven’t been that involved in neutrino physics before and who bring different perspectives,” Wilson said. “It’s all driven by the interest in the science, and the breadth of interest has been tremendous.”
Fermilab’s Scott Borton stands in front of shelves full of old scientific equipment. Many of these items will be put to future use through the Laboratory Equipment Donation Program. Photo: Dan Garisto
If you’re a scientist looking for a bargain on a UV lamp source, CompuFlow thermo-anemometer, miscellaneous fiber optic components or an oscilloscope, Fermilab has you covered.
At the lab’s Warehouse No. 2, racks piled high with items stretch into the distance. When equipment at Fermilab is no longer needed, it’s picked up and stored here, where much of it is processed and sent to schools, universities and government agencies who request it.
The whole operation is run by Scott Borton, who oversees three separate initiatives at Fermilab: Computers for Learning, the Federal Disposal System and the Laboratory Equipment Donation Program (LEDP). Between 2015 and 2017, the total value of assets donated through all three programs was over $3,000,000.
For Fermilab, it’s a great way to extend the life of equipment that’s come to the end of its usefulness for the laboratory. And for prospective buyers, it’s hard to imagine a better deal.
“This is all free. They pay for shipping and that’s it,” Borton said.
Designed to reduce waste and provide opportunities for schools, labs and agencies lacking the funds, the programs are well-used at Fermilab, with items sent to Borton on a regular basis.
Fermilab employees send to the warehouse old or underused equipment that they no longer need. Plenty of items come through the warehouse, so it’s not always clear what the status of this equipment is.
“In a lot of the cases, the equipment’s been moved and transferred so often that nobody has any idea if it works or not,” Borton said.
When this happens, Borton and his staff often draw on the experience of Fermilab’s experts to determine the status of equipment to make sure it’s in working condition.
Although the equipment is used, the zero on the price tag is enticing for physics professors such as Raul Armendariz, who teaches at Queensborough Community College in New York City. Armendariz learned about LEDP and arranged for the equipment transfer through Fermilab’s QuarkNet program.
“Getting the laboratory equipment is so important,” Armendariz said. “It allows us to build detectors and create projects for students and have them take part in the learning community.”
In December, Armendariz used the nationwide LEDP program to purchase — at no cost — 1,800 pounds of plastic scintillator scavenged from Fermilab’s CDF detector, which was decommissioned in 2013. He plans to use the scintillator to set up a cosmic ray array at local high schools and colleges in New York City.
“We’re at a community college and we don’t have big money for this kind of stuff — that’s why the LEDP is crucial for us,” Armendariz said.
For Borton, recycling what was once state-of-the-art equipment to schools and other labs is just another day at work.
“At least the stuff isn’t going to scrap,” he said. “It’s being reused somewhere.”
The SIGNA PET MR from GE Healthcare is one of the many systems that will be updated to HELiOS in the coming 2 years. Image Image: GE Healthcare
What does running large particle accelerators have in common with hospital imaging scanners? The operating system for both requires high performance and stability.
Fermilab first developed Scientific Linux as an open-source operating system in 2004 to fulfill exactly these demands, and it continues to release new versions.
GE Healthcare, a company that builds medical imaging equipment, found that it had the same needs when it came to operating systems. It now employs Scientific Linux as a foundation for its own, customized HELiOS, which stands for Healthcare Enterprise Linux Operating System.
According to GE, more than 30,000 medical imaging machines worldwide use this SL-based operating system to search for broken bones, tumors and other injuries on organs, and their numbers will easily double in the next two years. On GE machines, HELiOS manages the whole process, from taking an image of a patient to reconstructing the image and even displaying it for doctors.
At Fermilab, Scientific Linux runs on all computers for particle accelerator operation and on most data taking systems for experiments. Many scientists use it every day to write simulations or perform data analysis.
“Originally we created Scientific Linux for the high-energy physics community, but it was never exclusively for them. Everybody can download and use it,” said Connie Sieh, Fermilab computer specialist and co-developer of Scientific Linux. “We were really surprised when GE contacted us. We had never expected that our SL would spread that far or that it would be used in medicine.”
GE initiated the contact with Fermilab about the software, discussing customization issues. From there, the two institutions began a regular, informal exchange of knowledge and ideas to improve both operating systems.
Fermilab uses Scientific Linux to control and monitor all accelerators on site from the main accelerator operations room. Photo credit: Reidar Hahn
“Now we talk and meet on a regular basis, which is great, and Fermilab assistance is very welcome,” said James Foris, senior system engineer at GE Healthcare. “This exchange really reflects the open-source mentality we all share in software development.”
Fermilab develops Scientific Linux in the same way most Linux distributions are developed: The source code is freely available and can be changed or customized. Fermilab’s computing experts continually customize the Red Hat Linux distribution to provide a stable, scalable and extensible operating system to support the needs of the scientific community. GE then leverages Fermilab’s Scientific Linux to create HELiOS, a Linux distribution for healthcare applications.
“We use this style of software development for our products to ensure that our customers get a stable system tailored to their needs,” Foris said. “And avoiding the extra costs for software licenses always helps.”
One other attractive feature of Scientific Linux is its long lifespan: A single SL version, such as SL version 7, is supported by updates for 10 years. (A quick lesson in new versions versus new updates: Installing a new version, say version 7, is like buying a new car, while updating a version, say from version 7 to 7.1, is like getting an oil change or new tires. An update includes some new features, but never a major change in the whole design of the software. Major changes are released as new versions, such as SL version 8.)
For GE, this long lifespan means that they can support the software of their magnetic resonance imagers and other systems for 10 years, providing publicly reviewed and available bug fixes and security updates, without making major changes, which can be inconvenient for their customers.
Fermilab’s computing experts increase the security of the operating system to fulfill the standards of usage at a Department of Energy national laboratory. They implement features for easy access to file sharing and data storage, which are crucial for high-performance computing. GE uses those computing features for their own image reconstruction.
Scientific Linux was created for running accelerators and calculating particle collisions, and now its use has extended to our everyday lives, assisting people worldwide with their health and well-being.
The Scientific Linux team wishes to thank Red Hat for its contributions to maintaining an open, free, collaborative, and transparent open source community for software development.
Jerry Zimmerman is a jack-of-all-trades at Fermilab. Photo: Reidar Hahn
How long have you worked at Fermilab?
Twenty-seven years. I started in 1990 working in what was at that time the Research Division, working on detector development on the 14th floor of the high-rise. The group had only six people, so I was the — as I am today — jack of all trades. Whether it was cryogenics, electronics, mechanical — I handled it all.
What might you do in a typical workday?
I have two different parts to my job. For my on-site job, I’m an engineering physicist. I do work in the Village area, where I work on plastic extrusion and the test beam area, helping keep that running.
The rest of my job is my role as Mr. Freeze.
How did you become Mr. Freeze?
I’m actually Mr. Freeze III. Stan Stoy was the first one, back in the ’70s. In the early ‘90s, the Education Office came and asked if I would be willing to pick it up. My background in cryogenics allowed me to be creative in the position, and as of May 31 of this year, I’ll have been Mr. Freeze for 20 years. (Editor’s note: Jerry proudly pointed to his shirt with “Mr. Freeze” monogrammed on it when he said this.)
What kind of responsibilities do you have as Mr. Freeze?
My department, the Particle Physics Division, allows me 20 percent of my time to do shows. But that’s just day time — I also get requested for evening and weekend shows, which I do on my own time. I do about 120 events a year overall.
My goal during these shows is mostly to get kids excited about science. I want to show them things that they’re not going to see every day. If I can generate interest in science that keeps them going, I’ve succeeded.
What’s something people might not know about you?
My pastime, my outside exercise activity is roller skating. I’m actually a pretty good roller skater, which is probably surprising to some people. They see “The Big Bang Theory” and don’t expect a physicist to be good at something like that.