Meta 的 SAM 3 与 DINOv3 如何支撑能源部 Genesis Mission 首批科学项目

Lawrence Berkeley National Laboratory — one of the US Department of Energy's premier research laboratories, known for Nobel Prize-winning work in physics, chemistry, and materials science — operates some of the most advanced scientific facilities on the planet. Among them is the Advanced Light Source (ALS), a football field-sized facility that produces intensely bright beams of X-ray light, allowing researchers to study materials from the atomic and molecular scale all the way to plants. The ALS's instruments, known as beamlines, generate enormous quantities of data — and as recent facility upgrades have dramatically increased their resolution and speed, the volume of data has exploded beyond what scientists can keep up with.

The numbers are staggering: The DOE's light and neutron source facilities now produce tens of petabytes of data annually — that's millions of gigabytes, roughly equivalent to streaming 2 million hours of HD video. This backlog didn't always exist. Upgraded detectors, which have gone from capturing a single image every six seconds to 100,000 images per second, mean these facilities now generate orders of magnitude more data than they did a decade ago, and traditional manual analysis simply can't keep pace.

The problem goes beyond volume: domain experts are scarce and overwhelmed, and modern in-situ experiments — where scientists observe dynamic processes like chemical reactions or material failures as they occur — demand real-time interpretation that no human team can deliver manually.

Much of the analysis challenge comes down to one task: segmentation — the process of identifying and drawing precise boundaries around distinct structures within an image. In computer vision, segmentation is what enables everything from medical scans that distinguish tumors from healthy tissue to autonomous vehicles that separate pedestrians from pavement. In scientific research, segmentation is what transforms a raw X-ray image from a wall of grayscale pixels into a labeled map of meaningful structures — cell walls, mineral grains, semiconductor layers — that researchers can quantify and compare across experiments.

SYNAPS-I and the Genesis Mission

In late 2025, the White House launched The Genesis Mission, a sweeping national initiative to accelerate scientific discovery and technological leadership using advanced artificial intelligence, led by DOE. SYNAPS-I (SYnergistic Neutron And Photon Science – Intelligence) is one of its flagship projects: a multi-lab initiative led by Berkeley Lab, in partnership with Argonne, Brookhaven, Oak Ridge, and SLAC National Laboratories, aimed at transforming data analysis across X-ray and neutron science from a months-long bottleneck into a real-time discovery engine, with scientific imaging as a major target. Nowhere is that bottleneck more acute than in image segmentation, where extracting meaningful structures from experimental data can consume weeks of expert effort per dataset.

At the heart of SYNAPS-I's segmentation pipeline are two open-source foundation models released by Meta: Segment Anything Model 3 (SAM 3) and DINOv3.

How SAM and DINO Transform Scientific Imaging

DINOv3 is a self-supervised vision model, meaning it learns visual patterns from raw images without requiring humans to label them first. It excels at understanding what different structures in an image represent and where they are located. SAM takes that understanding a step further, drawing precise boundaries around individual objects in an image — much like a scientist carefully outlining structures by hand, but in seconds rather than hours.

Together, the two models form a complementary pipeline: SAM delivers precise, pixel-level boundaries, while DINO provides global context to identify each structure and its place within the sample. The SYNAPS-I team fine-tuned both models on scientific imaging data collected at DOE beamlines, then deployed them across 300 A100 GPUs — the high-performance computing chips that power today's most advanced AI systems — at national supercomputing facilities such as NERSC. The result: a fully reconstructed, semantically labeled 3D volume delivered back to the scientist physically standing at the beamline instrument, ready for interpretation while the experiment is still running. Total turnaround: approximately 15 minutes.

The SYNAPS-I team demonstrated this pipeline on a pressing agricultural challenge — understanding how grapevines respond to drought at the cellular level. Using micro-CT scans collected at the Advanced Light Source, the pipeline reconstructs 3D volumes of vine stems and automatically identifies xylem vessels — the microscopic tubes responsible for water transport within the plant. By tracking how these vessels change as drought progresses, researchers gain insights that could inform the development of drought-resilient crops, and provide solutions for agricultural resilience into the future.

Micro-CT scan of a grapevine stem, segmented by SYNAPS-I. Cyan: hydrated xylem vessels; dark purple: dry.

What previously required a month of expert annotation per time step now takes 15 minutes, enabling scientists to study dynamic biological processes at the speed of data acquisition itself.

Why Open Source Matters

National laboratories keep prepublication research data and AI models on government infrastructure, not external cloud services. This work must be managed on secure platforms while in progress. Meta's open source approach makes this possible. The SYNAPS-I team can download, fine-tune, and deploy SAM and DINO within their own secure computing environments, adapting models originally trained on natural images to scientific domains they were never designed for.

With 60 researchers across five national labs, SYNAPS-I is building toward a future where user facilities operate as intelligent discovery platforms — where AI doesn't just process data faster, but helps scientists generate hypotheses, recommends next experiments, and transfers knowledge across facilities so that a breakthrough at one beamline benefits researchers at all of them. As Genesis scales from seed projects to full programs, that open source foundation is poised to accelerate discovery across an expanding set of national priorities.

At the recent Trillion Parameter Consortium, DOE Under Secretary Dario Gil referred to the promise of this effort.

"By seamlessly combining AI, advanced computing, and experimental systems, SYNAPS-I analyzes data as it's produced and guides experiments in real time, replacing slow manual steps with adaptive, automated decision-making," he said. "This compresses discovery time from days to moments and establishes a continuous, self-improving model of science that will be essential to realizing the full potential of the Genesis Mission."

Our latest updates delivered to your inbox

Subscribe to our newsletter to keep up with Meta AI news, events, research breakthroughs, and more.