Volume 39, Issue 9
VALUE SPECIAL ISSUE ARTICLE

An intercomparison of a large ensemble of statistical downscaling methods over Europe: Results from the VALUE perfect predictor cross‐validation experiment

J. M. Gutiérrez

Corresponding Author

E-mail address: gutierjm@unican.es

Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain

Correspondence

J. M. Gutiérrez, Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain.

Email: gutierjm@unican.es

Search for more papers by this author
D. Maraun

Wegener Center for Climate and Global Change, University of Graz, Graz, Austria

Search for more papers by this author
M. Widmann

School of Geography, Earth and Environmental Sciences, University of Birmingham, Birmingham, UK

Search for more papers by this author
R. Huth

Department of Physical Geography and Geoecology, Faculty of Science, Charles University, Prague, Czech Republic

Institute of Atmospheric Physics, Czech Academy of Sciences, Prague, Czech Republic

Search for more papers by this author
E. Hertig

Institute of Geography, University of Augsburg, Augsburg, Germany

Search for more papers by this author
R. Benestad

The Norwegian Meteorological Institute, Osla, Norway

Search for more papers by this author
O. Roessler

Department of Geography/Oeschger Centre for Climate Change Research, University of Bern, Bern, Switzerland

Search for more papers by this author
J. Wibig

Department of Meteorology and Climatology, University of Lodz, Lodz, Poland

Search for more papers by this author
R. Wilcke

Rossby Centre, Swedish Meteorological and Hydrological Institute, Norrköping, Sweden

Search for more papers by this author
S. Kotlarski

Federal Office of Meteorology and Climatology MeteoSwiss, Zurich, Switzerland

Search for more papers by this author
D. San Martín

Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain

Predictia Intelligent Data Solutions, SME, Madrid, Spain

Search for more papers by this author
S. Herrera

Meteorology Group, Departamento de Matemática Aplicada y Computación, University of Cantabria, Santander, Spain

Search for more papers by this author
J. Bedia

Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain

Search for more papers by this author
A. Casanueva

Meteorology Group, Departamento de Matemática Aplicada y Computación, University of Cantabria, Santander, Spain

Search for more papers by this author
R. Manzanas

Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain

Search for more papers by this author
M. Iturbide

Meteorology Group, Instituto de Física de Cantabria, CSIC‐University of Cantabria, Santander, Spain

Search for more papers by this author
M. Vrac

Laboratoire des Sciences du Climat et de l'Environnement (LSCE‐IPSL/CNRS), Paris, France

Search for more papers by this author
M. Dubrovsky

Institute of Atmospheric Physics, Czech Academy of Sciences, Prague, Czech Republic

Global Change Research Institute, Czech Academy of Sciences, Brno, Czech Republic

Search for more papers by this author
J. Ribalaygua

Fundación Para la Investigación del Clima (FIC), Madrid, Spain

Search for more papers by this author
J. Pórtoles

Fundación Para la Investigación del Clima (FIC), Madrid, Spain

Search for more papers by this author
B. Hingray

Université Grenoble Alpes, CNRS, IRD, Grenoble INP, IGE, Grenoble, France

Search for more papers by this author
D. Raynaud

Université Grenoble Alpes, CNRS, IRD, Grenoble INP, IGE, Grenoble, France

Search for more papers by this author
M. J. Casado

Agencia Estatal de Meteorología (AEMET), Madrid, Spain

Search for more papers by this author
P. Ramos

Agencia Estatal de Meteorología (AEMET), Madrid, Spain

Search for more papers by this author
T. Zerenner

Meteorological Institute, University of Bonn, Bonn, Germany

Search for more papers by this author
M. Turco

Department of Applied Physics, University of Barcelona, Barcelona, Spain

Search for more papers by this author
T. Bosshard

Swedish Meteorological and Hydrological Institute (SMHI), Norrköping, Sweden

Search for more papers by this author
P. Štěpánek

Global Change Research Institute, Czech Academy of Sciences, Brno, Czech Republic

Search for more papers by this author
D. E. Keller

Federal Office of Meteorology and Climatology MeteoSwiss, Zurich, Switzerland

Center for Climate Systems Modeling (C2SM), ETH Zurich, Zurich, Switzerland

Search for more papers by this author
A. M. Fischer

Federal Office of Meteorology and Climatology MeteoSwiss, Zurich, Switzerland

Search for more papers by this author
R. M. Cardoso

Instituto Dom Luiz, Faculdade de Ciências, Universidade de Lisboa (IDL), Lisboa, Portugal

Search for more papers by this author
P. M. M. Soares

Instituto Dom Luiz, Faculdade de Ciências, Universidade de Lisboa (IDL), Lisboa, Portugal

Search for more papers by this author
C. Pagé

CECI, Université de Toulouse, CNRS, Cerfacs, Toulouse, France

Search for more papers by this author
First published: 23 March 2018
Citations: 43
Funding information MINECO/FEDER, Grant/Award Number: CGL2014‐52571‐R; FP7‐ENV‐2012, Grant/Award Number: 308601; Ministry of Education, Youth, and Sports of the Czech Republic, Grant/Award Number: LD12029, LD14043, LD12059

Abstract

VALUE is an open European collaboration to intercompare downscaling approaches for climate change research, focusing on different validation aspects (marginal, temporal, extremes, spatial, process‐based, etc.). Here we describe the participating methods and first results from the first experiment, using “perfect” reanalysis (and reanalysis‐driven regional climate model (RCM)) predictors to assess the intrinsic performance of the methods for downscaling precipitation and temperatures over a set of 86 stations representative of the main climatic regions in Europe. This study constitutes the largest and most comprehensive to date intercomparison of statistical downscaling methods, covering the three common downscaling approaches (perfect prognosis, model output statistics—including bias correction—and weather generators) with a total of over 50 downscaling methods representative of the most common techniques.

Overall, most of the downscaling methods greatly improve (reanalysis or RCM) raw model biases and no approach or technique seems to be superior in general, because there is a large method‐to‐method variability. The main factors most influencing the results are the seasonal calibration of the methods (e.g., using a moving window) and their stochastic nature. The particular predictors used also play an important role in cases where the comparison was possible, both for the validation results and for the strength of the predictor–predictand link, indicating the local variability explained. However, the present study cannot give a conclusive assessment of the skill of the methods to simulate regional future climates, and further experiments will be soon performed in the framework of the EURO‐CORDEX initiative (where VALUE activities have merged and follow on).

Finally, research transparency and reproducibility has been a major concern and substantive steps have been taken. In particular, the necessary data to run the experiments are provided at http://www.value‐cost.eu/data and data and validation results are available from the VALUE validation portal for further investigation: http://www.value‐cost.eu/validationportal.

Number of times cited according to CrossRef: 43

  • Testing bias adjustment methods for regional climate change applications under observational uncertainty and resolution mismatch, Atmospheric Science Letters, 10.1002/asl.978, 21, 7, (2020).
  • Evaluation of the EURO‐CORDEX Regional Climate Models Over the Iberian Peninsula: Observational Uncertainty Analysis, Journal of Geophysical Research: Atmospheres, 10.1029/2020JD032880, 125, 12, (2020).
  • Space-time simulation of precipitation based on weather pattern sub-sampling and meta-Gaussian model, Journal of Hydrology, 10.1016/j.jhydrol.2019.124451, 581, (124451), (2020).
  • Hydrologic Impacts of Surface Elevation and Spatial Resolution in Statistical Correction Approaches: Case Study of Flumendosa Basin, Italy, Journal of Hydrologic Engineering, 10.1061/(ASCE)HE.1943-5584.0001969, 25, 9, (05020032), (2020).
  • Impacts of Using State‐of‐the‐Art Multivariate Bias Correction Methods on Hydrological Modeling Over North America, Water Resources Research, 10.1029/2019WR026659, 56, 5, (2020).
  • Regional climate downscaling over Europe: perspectives from the EURO-CORDEX community, Regional Environmental Change, 10.1007/s10113-020-01606-9, 20, 2, (2020).
  • Multisite Weather Generators Using Bayesian Networks: An Illustrative Case Study for Precipitation Occurrence, Water Resources Research, 10.1029/2019WR026416, 56, 7, (2020).
  • Differential Credibility Assessment for Statistical Downscaling, Journal of Applied Meteorology and Climatology, 10.1175/JAMC-D-19-0296.1, 59, 8, (1333-1349), (2020).
  • Future Changes in Water Supply and Demand for Las Vegas Valley: A System Dynamic Approach based on CMIP3 and CMIP5 Climate Projections, Hydrology, 10.3390/hydrology7010016, 7, 1, (16), (2020).
  • Statistical downscaling with the downscaleR package (v3.1.0): contribution to the VALUE intercomparison experiment, Geoscientific Model Development, 10.5194/gmd-13-1711-2020, 13, 3, (1711-1735), (2020).
  • Configuration and intercomparison of deep learning neural models for statistical downscaling, Geoscientific Model Development, 10.5194/gmd-13-2109-2020, 13, 4, (2109-2124), (2020).
  • Fine scale surface climate in complex terrain using machine learning, International Journal of Climatology, 10.1002/joc.6617, 0, 0, (2020).
  • Remaining error sources in bias-corrected climate model outputs, Climatic Change, 10.1007/s10584-020-02744-z, (2020).
  • Projected Future Temporal Trends of Two Different Urban Heat Islands in Athens (Greece) under Three Climate Change Scenarios: A Statistical Approach, Atmosphere, 10.3390/atmos11060637, 11, 6, (637), (2020).
  • Statistical downscaling of water vapour satellite measurements from profiles of tropical ice clouds, Earth System Science Data, 10.5194/essd-12-1-2020, 12, 1, (1-20), (2020).
  • Fighting big data and ensemble fatigue in climate change impact studies: Can we turn the ensemble cascade upside down?, International Journal of Climatology, 10.1002/joc.6696, 0, 0, (2020).
  • Evaluation of some distributional downscaling methods as applied to daily maximum temperature with emphasis on extremes, International Journal of Climatology, 10.1002/joc.6288, 40, 3, (1571-1585), (2019).
  • The R-based climate4R open framework for reproducible climate data access and post-processing, Environmental Modelling & Software, 10.1016/j.envsoft.2018.09.009, 111, (42-54), (2019).
  • A hierarchical analysis of the impact of methodological decisions on statistical downscaling of daily precipitation and air temperatures, International Journal of Climatology, 10.1002/joc.5990, 39, 6, (2880-2900), (2019).
  • Validation of spatial variability in downscaling results from the VALUE perfect predictor experiment, International Journal of Climatology, 10.1002/joc.6024, 39, 9, (3819-3845), (2019).
  • Distribution of Anopheles vectors and potential malaria transmission stability in Europe and the Mediterranean area under future climate change, Parasites & Vectors, 10.1186/s13071-018-3278-6, 12, 1, (2019).
  • Evaluation and improvement of tail behaviour in the cumulative distribution function transform downscaling method, International Journal of Climatology, 10.1002/joc.5964, 39, 4, (2449-2460), (2019).
  • Evaluation of downscaling methods over Europe: Results of the EU‐COST action VALUE, International Journal of Climatology, 10.1002/joc.6184, 39, 9, (3689-3691), (2019).
  • Time Scale Decomposition of Climate and Correction of Variability Using Synthetic Samples of Stable Distributions, Water Resources Research, 10.1029/2018WR023053, 55, 5, (3632-3658), (2019).
  • Investigating mechanisms of social support effectiveness: The case of locomotion motivation, Personal Relationships, 10.1111/pere.12298, 26, 4, (654-679), (2019).
  • Romantic relationship commitment and the threat of alternatives on social media, Personal Relationships, 10.1111/pere.12299, 26, 4, (680-693), (2019).
  • The METACLIP semantic provenance framework for climate products, Environmental Modelling & Software, 10.1016/j.envsoft.2019.07.005, (2019).
  • Design Considerations for Riverine Floods in a Changing Climate – A Review, Journal of Hydrology, 10.1016/j.jhydrol.2019.04.068, (2019).
  • An intercomparison of multiple statistical downscaling methods for daily precipitation and temperature over China: present climate evaluations, Climate Dynamics, 10.1007/s00382-019-04809-x, (2019).
  • Weighted multi-model ensemble projection of extreme precipitation in the Mediterranean region using statistical downscaling, Theoretical and Applied Climatology, 10.1007/s00704-019-02851-7, (2019).
  • Climate projections of a multivariate heat stress index: the role of downscaling and bias correction, Geoscientific Model Development, 10.5194/gmd-12-3419-2019, 12, 8, (3419-3438), (2019).
  • Persistence of the high solar potential in Africa in a changing climate, Environmental Research Letters, 10.1088/1748-9326/ab51a1, 14, 12, (124036), (2019).
  • Bias adjustment and ensemble recalibration methods for seasonal forecasting: a comprehensive intercomparison using the C3S dataset, Climate Dynamics, 10.1007/s00382-019-04640-4, (2019).
  • Parametric gridded weather generator for use in present and future climates: focus on spatial temperature characteristics, Theoretical and Applied Climatology, 10.1007/s00704-019-03027-z, (2019).
  • ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing, Earth System Dynamics, 10.5194/esd-10-91-2019, 10, 1, (91-105), (2019).
  • Process‐based evaluation of the VALUE perfect predictor experiment of statistical downscaling methods, International Journal of Climatology, 10.1002/joc.5911, 39, 9, (3868-3893), (2018).
  • Statistical downscaling skill under present climate conditions: A synthesis of the VALUE perfect predictor experiment, International Journal of Climatology, 10.1002/joc.5877, 39, 9, (3692-3703), (2018).
  • Assessing variations of extreme indices inducing weather-hazards on critical infrastructures over Europe—the INTACT framework, Climatic Change, 10.1007/s10584-018-2184-4, 148, 1-2, (123-138), (2018).
  • Strategy for generation of climate change projections feeding Spanish impact community, Advances in Science and Research, 10.5194/asr-15-217-2018, 15, (217-230), (2018).
  • Intercomparison of machine learning methods for statistical downscaling: the case of daily and extreme precipitation, Theoretical and Applied Climatology, 10.1007/s00704-018-2613-3, (2018).
  • A Statistical Parameter Correction Technique for WRF Medium-Range Prediction of Near-Surface Temperature and Wind Speed Using Generalized Linear Model, Atmosphere, 10.3390/atmos9080291, 9, 8, (291), (2018).
  • Mean and extreme temperatures in a warming climate: EURO CORDEX and WRF regional climate high-resolution projections for Portugal, Climate Dynamics, 10.1007/s00382-018-4124-4, (2018).
  • Downscaling probability of long heatwaves based on seasonal mean daily maximum temperatures, Advances in Statistical Climatology, Meteorology and Oceanography, 10.5194/ascmo-4-37-2018, 4, 1/2, (37-52), (2018).