Volume 143, Issue 707
Featured Review Article

Stochastic representations of model uncertainties at ECMWF: state of the art and future vision

Martin Leutbecher

Corresponding Author

E-mail address: M.Leutbecher@ecmwf.int

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Correspondence to: M. Leutbecher, ECMWF, Shinfield Park, Reading, RG2 9AX, UK. E‐mail: M.Leutbecher@ecmwf.intSearch for more papers by this author
Sarah‐Jane Lock

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Pirkka Ollinaho

Climate Research, Finnish Meteorological Institute, Helsinki, Finland

Search for more papers by this author
Simon T. K. Lang

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Gianpaolo Balsamo

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Peter Bechtold

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Massimo Bonavita

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Hannah M. Christensen

Atmospheric, Oceanic and Planetary Physics, University of Oxford, UK

Search for more papers by this author
Michail Diamantakis

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Emanuel Dutra

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Stephen English

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Michael Fisher

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Richard M. Forbes

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Jacqueline Goddard

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Thomas Haiden

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Robin J. Hogan

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Stephan Juricke

Atmospheric, Oceanic and Planetary Physics, University of Oxford, UK

Search for more papers by this author
Heather Lawrence

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Dave MacLeod

Atmospheric, Oceanic and Planetary Physics, University of Oxford, UK

Search for more papers by this author
Linus Magnusson

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Sylvie Malardel

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Sebastien Massart

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Irina Sandu

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Piotr K. Smolarkiewicz

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Aneesh Subramanian

Atmospheric, Oceanic and Planetary Physics, University of Oxford, UK

Search for more papers by this author
Frédéric Vitart

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Nils Wedi

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Search for more papers by this author
Antje Weisheimer

European Centre for Medium‐Range Weather Forecasts, Reading, UK

Atmospheric, Oceanic and Planetary Physics, University of Oxford, UK

Department of Physics, National Centre for Atmospheric Science, University of Oxford, UK

Search for more papers by this author
First published: 13 June 2017
Citations: 84

Abstract

Members in ensemble forecasts differ due to the representations of initial uncertainties and model uncertainties. The inclusion of stochastic schemes to represent model uncertainties has improved the probabilistic skill of the ECMWF ensemble by increasing reliability and reducing the error of the ensemble mean. Recent progress, challenges and future directions regarding stochastic representations of model uncertainties at ECMWF are described in this article. The coming years are likely to see a further increase in the use of ensemble methods in forecasts and assimilation. This will put increasing demands on the methods used to perturb the forecast model. An area that is receiving greater attention than 5–10 years ago is the physical consistency of the perturbations. Other areas where future efforts will be directed are the expansion of uncertainty representations to the dynamical core and other components of the Earth system, as well as the overall computational efficiency of representing model uncertainty.

Number of times cited according to CrossRef: 84

  • Constraining stochastic parametrisation schemes using high‐resolution simulations, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3717, 146, 727, (938-962), (2020).
  • Reduced‐precision parametrization: lessons from an intermediate‐complexity atmospheric model, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3754, 146, 729, (1590-1607), (2020).
  • Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model, Journal of Advances in Modeling Earth Systems, 10.1029/2019MS001896, 12, 3, (2020).
  • Towards an unbiased stratospheric analysis, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3798, 146, 730, (2392-2409), (2020).
  • Assessing the Impact of Stochastic Perturbations in Cloud Microphysics using GOES-16 Infrared Brightness Temperatures, Monthly Weather Review, 10.1175/MWR-D-20-0078.1, 148, 8, (3111-3137), (2020).
  • Exploring the limits of ensemble forecasting via solutions of the Liouville equation for realistic geophysical models, Atmospheric Research, 10.1016/j.atmosres.2020.105127, 246, (105127), (2020).
  • The ERA5 global reanalysis, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3803, 146, 730, (1999-2049), (2020).
  • Assessment of the Forecast Skill of Multiphysics and Multistochastic Methods within the GRAPES Regional Ensemble Prediction System in the East Asian Monsoon Region, Weather and Forecasting, 10.1175/WAF-D-19-0021.1, 35, 3, (1145-1171), (2020).
  • Improving Solution Accuracy and Convergence for Stochastic Physics Parameterizations with Colored Noise, Monthly Weather Review, 10.1175/MWR-D-19-0178.1, 148, 6, (2251-2263), (2020).
  • Representing Model Uncertainty by Multi-Stochastic Physics Approaches in the GRAPES Ensemble, Advances in Atmospheric Sciences, 10.1007/s00376-020-9171-1, 37, 4, (328-346), (2020).
  • Subseasonal to Seasonal Prediction of Weather to Climate with Application to Tropical Cyclones, Journal of Geophysical Research: Atmospheres, 10.1029/2018JD029375, 125, 6, (2020).
  • Comments on “What Is the Predictability Limit of Midlatitude Weather?”, Journal of the Atmospheric Sciences, 10.1175/JAS-D-19-0166.1, 77, 2, (781-785), (2020).
  • Reply to “Comments on ‘What Is the Predictability Limit of Midlatitude Weather?’”, Journal of the Atmospheric Sciences, 10.1175/JAS-D-19-0308.1, 77, 2, (787-793), (2020).
  • Sensitivity to Tendency Perturbations of Tropical Cyclone Short-range Intensity Forecasts Generated by WRF, Advances in Atmospheric Sciences, 10.1007/s00376-019-9187-6, 37, 3, (291-306), (2020).
  • Probabilistic thunderstorm forecasting by blending multiple ensembles, Tellus A: Dynamic Meteorology and Oceanography, 10.1080/16000870.2019.1696142, 72, 1, (1-19), (2020).
  • Evaluation of Stochastic Perturbed Parameterization Tendencies on Convective-Permitting Ensemble Forecasts of Heavy Rainfall Events in New York and Taiwan, Weather and Forecasting, 10.1175/WAF-D-19-0064.1, 35, 1, (5-24), (2020).
  • Forecast Errors and Uncertainties in Atmospheric Rivers, Weather and Forecasting, 10.1175/WAF-D-20-0049.1, 35, 4, (1447-1458), (2020).
  • Potential skill of continental-scale, medium-range ensemble streamflow forecasts for flood prediction in South America, Journal of Hydrology, 10.1016/j.jhydrol.2020.125430, (125430), (2020).
  • Fifty Years of Research on the Madden‐Julian Oscillation: Recent Progress, Challenges, and Perspectives, Journal of Geophysical Research: Atmospheres, 10.1029/2019JD030911, 125, 17, (2020).
  • Current and Emerging Developments in Subseasonal to Decadal Prediction, Bulletin of the American Meteorological Society, 10.1175/BAMS-D-19-0037.1, 101, 6, (E869-E896), (2020).
  • Simulating model uncertainty of subgrid-scale processes by sampling model errors at convective scales, Nonlinear Processes in Geophysics, 10.5194/npg-27-187-2020, 27, 2, (187-207), (2020).
  • Representing model uncertainty for global atmospheric CO<sub>2</sub> flux inversions using ECMWF-IFS-46R1, Geoscientific Model Development, 10.5194/gmd-13-2297-2020, 13, 5, (2297-2313), (2020).
  • Ensemble hindcasting of wind and wave conditions with WRF and WAVEWATCH III&#174; driven by ERA5, Ocean Science, 10.5194/os-16-355-2020, 16, 2, (355-371), (2020).
  • Model Uncertainty Representation for a Convection-Allowing Ensemble Prediction System Based on CNOP-P, Advances in Atmospheric Sciences, 10.1007/s00376-020-9262-z, (2020).
  • Reforecasting the November 1994 flooding of Piedmont with a convection-permitting model, Bulletin of Atmospheric Science and Technology, 10.1007/s42865-020-00017-2, (2020).
  • The future of forecasting for renewable energy, WIREs Energy and Environment, 10.1002/wene.365, 9, 2, (2019).
  • On the probabilistic skill of dual‐resolution ensemble forecasts, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3704, 146, 727, (707-723), (2019).
  • Flow‐dependent stochastic coupling for climate models with high ocean‐to‐atmosphere resolution ratio, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3674, 146, 726, (284-300), (2019).
  • A Model Framework for Stochastic Representation of Uncertainties Associated with Physical Processes in NOAA’s Next Generation Global Prediction System (NGGPS), Monthly Weather Review, 10.1175/MWR-D-18-0238.1, 147, 3, (893-911), (2019).
  • Reforecasting the Flooding of Florence of 4 November 1966 With Global and Regional Ensembles, Journal of Geophysical Research: Atmospheres, 10.1029/2018JD030231, 124, 7, (3743-3764), (2019).
  • HarmonEPS—The HARMONIE Ensemble Prediction System, Weather and Forecasting, 10.1175/WAF-D-19-0030.1, 34, 6, (1909-1937), (2019).
  • An Ensemble-Based Probabilistic Score Approach to Compare Observation Scenarios: An Application to Biogeochemical-Argo Deployments, Journal of Atmospheric and Oceanic Technology, 10.1175/JTECH-D-19-0002.1, 36, 12, (2307-2326), (2019).
  • Impact of land surface stochastic physics in ALADIN‐LAEF, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3623, 145, 724, (3333-3350), (2019).
  • Treatment of model uncertainty from radiation by the Stochastically Perturbed Parametrization Tendencies (SPPT) scheme and associated revisions in the ECMWF ensembles, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3570, 145, S1, (75-89), (2019).
  • Dependence on initial conditions versus model formulations for medium‐range forecast error variations, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3545, 145, 722, (2085-2100), (2019).
  • Inference of stochastic parametrizations for model error treatment using nested ensemble Kalman filters, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3542, 145, 722, (2028-2045), (2019).
  • From reliable weather forecasts to skilful climate response: A dynamical systems approach, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3476, 145, 720, (1052-1069), (2019).
  • The ensemble‐adjusted Ignorance Score for forecasts issued as normal distributions, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3447, 145, S1, (129-139), (2019).
  • References, Statistical Methods in the Atmospheric Sciences, 10.1016/B978-0-12-815823-4.09992-2, (771-805), (2019).
  • Ensemble Forecasting, Statistical Methods in the Atmospheric Sciences, 10.1016/B978-0-12-815823-4.00008-0, (313-367), (2019).
  • A Stochastic Representation of Subgrid Uncertainty for Dynamical Core Development, Bulletin of the American Meteorological Society, 10.1175/BAMS-D-17-0040.1, 100, 6, (1091-1101), (2019).
  • Bore-ing into Nocturnal Convection, Bulletin of the American Meteorological Society, 10.1175/BAMS-D-17-0250.1, 100, 6, (1103-1121), (2019).
  • Modification of Potential Vorticity near the Tropopause by Nonconservative Processes in the ECMWF Model, Journal of the Atmospheric Sciences, 10.1175/JAS-D-18-0295.1, 76, 6, (1709-1726), (2019).
  • A Hybrid Stochastically Perturbed Parametrization Scheme in a Convection-Permitting Ensemble, Monthly Weather Review, 10.1175/MWR-D-18-0415.1, 147, 6, (2217-2230), (2019).
  • Stochastic Parameterization of Subgrid-Scale Velocity Enhancement of Sea Surface Fluxes, Monthly Weather Review, 10.1175/MWR-D-18-0384.1, 147, 5, (1447-1469), (2019).
  • ECMWF Activities for Improved Hurricane Forecasts, Bulletin of the American Meteorological Society, 10.1175/BAMS-D-18-0044.1, 100, 3, (445-458), (2019).
  • Ocean kinetic energy backscatter parametrizations on unstructured grids: Impact on mesoscale turbulence in a channel, Ocean Modelling, 10.1016/j.ocemod.2019.03.009, (2019).
  • Sensitivities of the NCEP Global Forecast System, Monthly Weather Review, 10.1175/MWR-D-18-0239.1, 147, 4, (1237-1256), (2019).
  • The Impact of Stochastically Perturbed Parameterizations on Tornadic Supercell Cases in East China, Monthly Weather Review, 10.1175/MWR-D-18-0182.1, 147, 1, (199-220), (2019).
  • Stochastically Perturbed Parameterizations in an HRRR-Based Ensemble, Monthly Weather Review, 10.1175/MWR-D-18-0092.1, 147, 1, (153-173), (2019).
  • Sources of uncertainty in atmospheric dispersion modeling in support of Comprehensive Nuclear–Test–Ban Treaty monitoring and verification system, Atmospheric Pollution Research, 10.1016/j.apr.2019.03.008, (2019).
  • Daily evaluation of 26 precipitation datasets using Stage-IV gauge-radar data for the CONUS, Hydrology and Earth System Sciences, 10.5194/hess-23-207-2019, 23, 1, (207-224), (2019).
  • SEAS5: the new ECMWF seasonal forecast system, Geoscientific Model Development, 10.5194/gmd-12-1087-2019, 12, 3, (1087-1117), (2019).
  • Land-surface parameter and state perturbations in the Global Ensemble Forecast System, Monthly Weather Review, 10.1175/MWR-D-18-0057.1, (2019).
  • Seasonal forecasts of the East African long rains: insight from atmospheric relaxation experiments, Climate Dynamics, 10.1007/s00382-019-04800-6, (2019).
  • An evaluation and improvement of tropical cyclone prediction in the western North Pacific basin from global ensemble forecasts, Science China Earth Sciences, 10.1007/s11430-019-9480-8, (2019).
  • Relative impact of aerosol, soil moisture, and orography perturbations on deep convection, Atmospheric Chemistry and Physics, 10.5194/acp-19-12343-2019, 19, 19, (12343-12359), (2019).
  • Progress towards a probabilistic Earth system model: examining the impact of stochasticity in the atmosphere and land component of EC-Earth v3.2, Geoscientific Model Development, 10.5194/gmd-12-3099-2019, 12, 7, (3099-3118), (2019).
  • Independent perturbations for physics parametrization tendencies in a convection-permitting ensemble (pSPPT), Geoscientific Model Development, 10.5194/gmd-12-261-2019, 12, 1, (261-273), (2019).
  • The Taiwan WRF Ensemble Prediction System: Scientific Description, Model-Error Representation and Performance Results, Asia-Pacific Journal of Atmospheric Sciences, 10.1007/s13143-019-00127-8, (2019).
  • Using reference radiosondes to characterise NWP model uncertainty for improved satellite calibration and validation, Atmospheric Measurement Techniques, 10.5194/amt-12-83-2019, 12, 1, (83-106), (2019).
  • Using the ECMWF OpenIFS model and state-of-the-art training techniques in meteorological education, Advances in Science and Research, 10.5194/asr-16-39-2019, 16, (39-47), (2019).
  • Uncertainty and scale interactions in ocean ensembles: From seasonal forecasts to multidecadal climate predictions, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3397, 145, S1, (160-175), (2018).
  • Ensemble size: How suboptimal is less than infinity?, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3387, 145, S1, (107-128), (2018).
  • Introduction to the special issue on “25 years of ensemble forecasting”, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3370, 145, S1, (1-11), (2018).
  • Seasonal predictability of onset and cessation of the east African rains, Weather and Climate Extremes, 10.1016/j.wace.2018.05.003, 21, (27-35), (2018).
  • Prediction of the Madden–Julian Oscillation: A Review, Journal of Climate, 10.1175/JCLI-D-18-0210.1, 31, 23, (9425-9443), (2018).
  • Seasonal to annual ocean forecasting skill and the role of model and observational uncertainty, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3394, 144, 715, (1947-1964), (2018).
  • Climate, weather, space weather: model development in an operational context, Journal of Space Weather and Space Climate, 10.1051/swsc/2018021, 8, (A32), (2018).
  • Ensemble Spread Grows More Rapidly in Higher-Resolution Simulations of Deep Convection, Journal of the Atmospheric Sciences, 10.1175/JAS-D-17-0332.1, 75, 10, (3331-3345), (2018).
  • On the Dynamical Mechanisms Governing El Niño–Southern Oscillation Irregularity, Journal of Climate, 10.1175/JCLI-D-18-0243.1, 31, 20, (8401-8419), (2018).
  • Design and development of the SLAV-INMIO-CICE coupled model for seasonal prediction and climate research, Russian Journal of Numerical Analysis and Mathematical Modelling, 10.1515/rnam-2018-0028, 33, 6, (333-340), (2018).
  • Can the Direct Effect of Aerosols Improve Subseasonal Predictability?, Monthly Weather Review, 10.1175/MWR-D-17-0282.1, 146, 10, (3481-3498), (2018).
  • Medium- and Extended-Range Ensemble Weather Forecasting, Weather & Climate Services for the Energy Industry, 10.1007/978-3-319-68418-5, (109-121), (2018).
  • Diagnosing, modeling, and testing a multiplicative stochastic Gent-McWilliams parameterization, Ocean Modelling, 10.1016/j.ocemod.2018.10.009, (2018).
  • Extreme Rainfall and Flooding over Central Kenya Including Nairobi City during the Long-Rains Season 2018: Causes, Predictability, and Potential for Early Warning and Actions, Atmosphere, 10.3390/atmos9120472, 9, 12, (472), (2018).
  • Climate model configurations of the ECMWF Integrated Forecasting System (ECMWF-IFS cycle 43r1) for HighResMIP, Geoscientific Model Development, 10.5194/gmd-11-3681-2018, 11, 9, (3681-3712), (2018).
  • Evaluating the MJO prediction skill from different configurations of NCEP GEFS extended forecast, Climate Dynamics, 10.1007/s00382-018-4423-9, (2018).
  • Satellite and In Situ Observations for Advancing Global Earth Surface Modelling: A Review, Remote Sensing, 10.3390/rs10122038, 10, 12, (2038), (2018).
  • An eddifying Stommel model: fast eddy effects in a two-box ocean, Geophysical & Astrophysical Fluid Dynamics, 10.1080/03091929.2018.1464566, (1-22), (2018).
  • Exchange Processes in the Atmospheric Boundary Layer Over Mountainous Terrain, Atmosphere, 10.3390/atmos9030102, 9, 3, (102), (2018).
  • Introducing independent patterns into the Stochastically Perturbed Parametrization Tendencies (SPPT) scheme, Quarterly Journal of the Royal Meteorological Society, 10.1002/qj.3075, 143, 706, (2168-2181), (2017).
  • Climate SPHINX: evaluating the impact of resolution and stochastic physics parameterisations in the EC-Earth global climate model, Geoscientific Model Development, 10.5194/gmd-10-1383-2017, 10, 3, (1383-1402), (2017).
  • Using ensemble reforecasts to generate flood thresholds for improved global flood forecasting, Journal of Flood Risk Management, 10.1111/jfr3.12658, 0, 0, (undefined).

Journal list menu