Part VI: Discovery in Scientific Domains
Chapter 51: Discovery AI for Climate and Earth Science

Discovery AI for Climate and Earth Science

"I predicted tomorrow's weather in 0.3 seconds on a single GPU. The humans spent forty years building the supercomputer I replaced."

A Graph Neural Network That Outran the Atmosphere

Overview

Numerical weather prediction (NWP) is one of the great triumphs of computational science. For six decades, operational centers like ECMWF, NOAA, and JMA have solved the primitive equations of atmospheric dynamics on ever finer grids, consuming billions of CPU hours per year. Yet even the most powerful supercomputers struggle with two persistent challenges: the computational cost of high-resolution forecasts, and the structural limitations of parameterized sub-grid physics. AI is now addressing both.

In 2023, a sequence of papers from Google DeepMind, Huawei, NVIDIA, and Caltech demonstrated that neural networks trained on reanalysis data can match or exceed the skill of operational NWP systems at medium-range weather forecasting. GraphCast, Pangu-Weather, FourCastNet, and NeuralGCM each take a different architectural approach (graph networks, 3D vision transformers, adaptive Fourier operators, hybrid learned-physics models), but they share a common result: producing 10-day global forecasts in seconds rather than hours.

This chapter covers four interconnected topics. We begin with AI weather prediction, examining the architectures and training regimes behind the leading models (Section 51.1). We then move to climate emulation and downscaling, where the goal shifts from forecasting individual weather events to reproducing the statistical properties of climate over decades, and from coarse global grids to fine regional detail (Section 51.2). Next, we tackle extreme event detection and attribution, using AI to identify rare events in observational data and to quantify the contribution of anthropogenic forcing to their probability (Section 51.3). Finally, we build a complete regional weather model by fine-tuning a pretrained architecture on a regional domain and evaluating it against ERA5 reanalysis using WeatherBench2 (Section 51.4).

These methods build on the scientific machine learning foundations of Chapter 33 (neural operators, physics-informed losses), the scientific foundation models of Chapter 27, and the scientific simulation framework of Chapter 43. They also connect to the causal inference methods of Chapter 31, which underpin the attribution science in Section 51.3.

Prerequisites

Readers should be comfortable with Chapter 33: Scientific Machine Learning for neural operator concepts, Chapter 27: Scientific Foundation Models for transfer learning and fine-tuning, and Chapter 5: Discovery Through Data, Models, and Simulation for the simulation paradigm. Familiarity with xarray and multidimensional climate data is helpful; Appendix B covers the necessary Python tooling. No prior atmospheric science training is required.

Learning Outcomes

Sections

51.1 AI Weather Prediction

GraphCast, Pangu-Weather, FourCastNet, and NeuralGCM architectures. Autoregressive rollout training. Physics constraints: conservation laws, spectral energy cascades, and pressure-level consistency. Evaluation against operational NWP with WeatherBench2.

51.2 Climate Emulation and Downscaling

Climate emulators that reproduce multi-decadal statistics at a fraction of GCM compute cost. Statistical and learned downscaling from coarse (1-degree) to fine (0.1-degree) resolution. Foundation models for earth observation. Carbon accounting with satellite data.

51.3 Extreme Events and Attribution

Detecting extreme weather events in high-dimensional climate data with anomaly detection. Optimal fingerprinting and detection-attribution analysis. Quantifying the role of anthropogenic forcing in individual events. Causal methods for climate attribution.

51.4 Building a Regional Weather Model

Recipe: fine-tune a pretrained weather model on a regional domain using ERA5 reanalysis. Evaluate with WeatherBench2 metrics. Deploy as a Discovery Workbench pipeline with xarray, Zarr, and Pangeo infrastructure.

What's Next

Climate and earth science showcase AI discovery at planetary scale, where physics constraints and observational data converge. Chapter 52: Discovery AI for Social and Economic Systems turns to a domain where the "laws" are not physical but behavioral: economic markets, social networks, and policy interventions. Where atmospheric physics provides strong conservation laws that constrain neural models, social systems offer weaker structural priors and richer causal complexity. The transition from geophysical to socioeconomic modeling tests whether the same AI discovery toolkit generalizes when the underlying science changes fundamentally.

Bibliography

AI Weather Prediction

Lam, R., et al. (2023). Learning skillful medium-range global weather forecasting. Science, 382(6677), 1416-1421.

GraphCast: a graph neural network that produces 10-day global forecasts matching ECMWF's HRES system, trained on 39 years of ERA5 reanalysis data.

Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., & Tian, Q. (2023). Accurate medium-range global weather forecasting with 3D neural networks. Nature, 619, 533-538.

Pangu-Weather: a 3D Earth-specific Transformer that achieves state-of-the-art forecast skill by processing pressure levels as a volumetric input.

Pathak, J., et al. (2022). FourCastNet: A global data-driven high-resolution weather forecasting model. arXiv preprint.

FourCastNet: an Adaptive Fourier Neural Operator (AFNO) architecture that generates 0.25-degree global forecasts in under a second.

Kochkov, D., et al. (2024). Neural general circulation models for weather and climate. Nature, 632, 1060-1066.

NeuralGCM: a hybrid model that couples learned physics parameterizations with a differentiable dynamical core, maintaining physical consistency over multi-year simulations.

Climate Emulation and Downscaling

Watson-Parris, D., et al. (2024). ClimateBench v1.0: A benchmark for data-driven climate projections. JAMES, 16, e2023MS003697.

A benchmark for evaluating climate emulators on spatial patterns of temperature and precipitation response to forcing scenarios.

Nguyen, T., et al. (2025). Scaling transformer neural networks for skillful and reliable medium-range weather forecasting. Nature.

Stormer: a vision Transformer trained at multiple resolutions with randomized dynamics for improved ensemble forecasting and uncertainty quantification.

Extreme Events and Attribution

Ribes, A., Qasmi, S., & Gillett, N. P. (2021). Making climate projections conditional on historical observations. Science Advances, 7(4), eabc0671.

Optimal fingerprinting methods that separate anthropogenic from natural climate signals using regularized regression.

Tools and Infrastructure

Rasp, S., et al. (2024). WeatherBench 2: A benchmark for the next generation of data-driven global weather models. JAMES, 16, e2023MS004019.

WeatherBench2: the standard evaluation framework for AI weather models, providing metrics, baselines, and ERA5 verification data.

Pangeo Community (2017-2024). Pangeo: A community platform for big data geoscience.

The Pangeo stack (xarray, Zarr, Dask, intake) provides scalable infrastructure for analysis-ready climate data.

Gorelick, N., et al. (2017). Google Earth Engine: Planetary-scale geospatial analysis for everyone. Remote Sensing of Environment, 202, 18-27.

Earth Engine provides petabyte-scale satellite imagery and geospatial analysis through a cloud-native Python API.

Miles, A., et al. (2024). Zarr: An implementation of chunked, compressed, N-dimensional arrays.

Zarr is the cloud-native array storage format that underpins most modern climate data archives, enabling parallel reads of multi-terabyte datasets.