Overview
Numerical weather prediction (NWP) is one of the great triumphs of computational science. For six decades, operational centers like ECMWF, NOAA, and JMA have solved the primitive equations of atmospheric dynamics on ever finer grids, consuming billions of CPU hours per year. Yet even the most powerful supercomputers struggle with two persistent challenges: the computational cost of high-resolution forecasts, and the structural limitations of parameterized sub-grid physics. AI is now addressing both.
In 2023, a sequence of papers from Google DeepMind, Huawei, NVIDIA, and Caltech demonstrated that neural networks trained on reanalysis data can match or exceed the skill of operational NWP systems at medium-range weather forecasting. GraphCast, Pangu-Weather, FourCastNet, and NeuralGCM each take a different architectural approach (graph networks, 3D vision transformers, adaptive Fourier operators, hybrid learned-physics models), but they share a common result: producing 10-day global forecasts in seconds rather than hours.
This chapter covers four interconnected topics. We begin with AI weather prediction, examining the architectures and training regimes behind the leading models (Section 51.1). We then move to climate emulation and downscaling, where the goal shifts from forecasting individual weather events to reproducing the statistical properties of climate over decades, and from coarse global grids to fine regional detail (Section 51.2). Next, we tackle extreme event detection and attribution, using AI to identify rare events in observational data and to quantify the contribution of anthropogenic forcing to their probability (Section 51.3). Finally, we build a complete regional weather model by fine-tuning a pretrained architecture on a regional domain and evaluating it against ERA5 reanalysis using WeatherBench2 (Section 51.4).
These methods build on the scientific machine learning foundations of Chapter 33 (neural operators, physics-informed losses), the scientific foundation models of Chapter 27, and the scientific simulation framework of Chapter 43. They also connect to the causal inference methods of Chapter 31, which underpin the attribution science in Section 51.3.
Prerequisites
Readers should be comfortable with Chapter 33: Scientific Machine Learning for neural operator concepts, Chapter 27: Scientific Foundation Models for transfer learning and fine-tuning, and Chapter 5: Discovery Through Data, Models, and Simulation for the simulation paradigm. Familiarity with xarray and multidimensional climate data is helpful; Appendix B covers the necessary Python tooling. No prior atmospheric science training is required.
Learning Outcomes
- Compare the architectures and training strategies of GraphCast, Pangu-Weather, FourCastNet, and NeuralGCM for global weather prediction.
- Explain how physics constraints (conservation laws, spectral energy cascades) are enforced in neural weather models.
- Implement climate emulators that reproduce multi-decadal statistical distributions and train statistical downscaling models from coarse to fine resolution.
- Apply anomaly detection and optimal fingerprinting to attribute extreme weather events to anthropogenic forcing.
- Work with the Pangeo ecosystem (xarray, Zarr, Dask) and Google Earth Engine for large-scale earth observation data.
- Fine-tune a pretrained weather model on a regional domain and evaluate forecast skill with WeatherBench2 metrics.
Sections
51.1 AI Weather Prediction
GraphCast, Pangu-Weather, FourCastNet, and NeuralGCM architectures. Autoregressive rollout training. Physics constraints: conservation laws, spectral energy cascades, and pressure-level consistency. Evaluation against operational NWP with WeatherBench2.
51.2 Climate Emulation and Downscaling
Climate emulators that reproduce multi-decadal statistics at a fraction of GCM compute cost. Statistical and learned downscaling from coarse (1-degree) to fine (0.1-degree) resolution. Foundation models for earth observation. Carbon accounting with satellite data.
51.3 Extreme Events and Attribution
Detecting extreme weather events in high-dimensional climate data with anomaly detection. Optimal fingerprinting and detection-attribution analysis. Quantifying the role of anthropogenic forcing in individual events. Causal methods for climate attribution.
51.4 Building a Regional Weather Model
Recipe: fine-tune a pretrained weather model on a regional domain using ERA5 reanalysis. Evaluate with WeatherBench2 metrics. Deploy as a Discovery Workbench pipeline with xarray, Zarr, and Pangeo infrastructure.
Bibliography
AI Weather Prediction
GraphCast: a graph neural network that produces 10-day global forecasts matching ECMWF's HRES system, trained on 39 years of ERA5 reanalysis data.
Pangu-Weather: a 3D Earth-specific Transformer that achieves state-of-the-art forecast skill by processing pressure levels as a volumetric input.
FourCastNet: an Adaptive Fourier Neural Operator (AFNO) architecture that generates 0.25-degree global forecasts in under a second.
NeuralGCM: a hybrid model that couples learned physics parameterizations with a differentiable dynamical core, maintaining physical consistency over multi-year simulations.
Climate Emulation and Downscaling
A benchmark for evaluating climate emulators on spatial patterns of temperature and precipitation response to forcing scenarios.
Stormer: a vision Transformer trained at multiple resolutions with randomized dynamics for improved ensemble forecasting and uncertainty quantification.
Extreme Events and Attribution
The World Weather Attribution protocol for rapid, rigorous attribution of extreme events to climate change.
Optimal fingerprinting methods that separate anthropogenic from natural climate signals using regularized regression.
Tools and Infrastructure
WeatherBench2: the standard evaluation framework for AI weather models, providing metrics, baselines, and ERA5 verification data.
The Pangeo stack (xarray, Zarr, Dask, intake) provides scalable infrastructure for analysis-ready climate data.
Earth Engine provides petabyte-scale satellite imagery and geospatial analysis through a cloud-native Python API.
Zarr is the cloud-native array storage format that underpins most modern climate data archives, enabling parallel reads of multi-terabyte datasets.