An intercomparison of a large ensemble of statistical downscaling methods over Europe: Results from the VALUE perfect predictor cross‐validation experiment
Abstract
VALUE is an open European collaboration to intercompare downscaling approaches for climate change research, focusing on different validation aspects (marginal, temporal, extremes, spatial, process‐based, etc.). Here we describe the participating methods and first results from the first experiment, using “perfect” reanalysis (and reanalysis‐driven regional climate model (RCM)) predictors to assess the intrinsic performance of the methods for downscaling precipitation and temperatures over a set of 86 stations representative of the main climatic regions in Europe. This study constitutes the largest and most comprehensive to date intercomparison of statistical downscaling methods, covering the three common downscaling approaches (perfect prognosis, model output statistics—including bias correction—and weather generators) with a total of over 50 downscaling methods representative of the most common techniques.
Overall, most of the downscaling methods greatly improve (reanalysis or RCM) raw model biases and no approach or technique seems to be superior in general, because there is a large method‐to‐method variability. The main factors most influencing the results are the seasonal calibration of the methods (e.g., using a moving window) and their stochastic nature. The particular predictors used also play an important role in cases where the comparison was possible, both for the validation results and for the strength of the predictor–predictand link, indicating the local variability explained. However, the present study cannot give a conclusive assessment of the skill of the methods to simulate regional future climates, and further experiments will be soon performed in the framework of the EURO‐CORDEX initiative (where VALUE activities have merged and follow on).
Finally, research transparency and reproducibility has been a major concern and substantive steps have been taken. In particular, the necessary data to run the experiments are provided at http://www.value‐cost.eu/data and data and validation results are available from the VALUE validation portal for further investigation: http://www.value‐cost.eu/validationportal.
Citing Literature
Number of times cited according to CrossRef: 43
- Ana Casanueva, Sixto Herrera, Maialen Iturbide, Stefan Lange, Martin Jury, Alessandro Dosio, Douglas Maraun, José M. Gutiérrez, Testing bias adjustment methods for regional climate change applications under observational uncertainty and resolution mismatch, Atmospheric Science Letters, 10.1002/asl.978, 21, 7, (2020).
- S. Herrera, P. M. M. Soares, R. M. Cardoso, J. M. Gutiérrez, Evaluation of the EURO‐CORDEX Regional Climate Models Over the Iberian Peninsula: Observational Uncertainty Analysis, Journal of Geophysical Research: Atmospheres, 10.1029/2020JD032880, 125, 12, (2020).
- Pradeebane Vaittinada Ayar, Juliette Blanchet, Emmanuel Paquet, David Penot, Space-time simulation of precipitation based on weather pattern sub-sampling and meta-Gaussian model, Journal of Hydrology, 10.1016/j.jhydrol.2019.124451, 581, (124451), (2020).
- Enrica Perra, Francesco Viola, Roberto Deidda, Domenico Caracciolo, Claudio Paniconi, Andreas Langousis, Hydrologic Impacts of Surface Elevation and Spatial Resolution in Statistical Correction Approaches: Case Study of Flumendosa Basin, Italy, Journal of Hydrologic Engineering, 10.1061/(ASCE)HE.1943-5584.0001969, 25, 9, (05020032), (2020).
- Qiang Guo, Jie Chen, Xunchang John Zhang, Chong‐Yu Xu, Hua Chen, Impacts of Using State‐of‐the‐Art Multivariate Bias Correction Methods on Hydrological Modeling Over North America, Water Resources Research, 10.1029/2019WR026659, 56, 5, (2020).
- Daniela Jacob, Claas Teichmann, Stefan Sobolowski, Eleni Katragkou, Ivonne Anders, Michal Belda, Rasmus Benestad, Fredrik Boberg, Erasmo Buonomo, Rita M. Cardoso, Ana Casanueva, Ole B. Christensen, Jens Hesselbjerg Christensen, Erika Coppola, Lesley De Cruz, Edouard L. Davin, Andreas Dobler, Marta Domínguez, Rowan Fealy, Jesus Fernandez, Miguel Angel Gaertner, Markel García-Díez, Filippo Giorgi, Andreas Gobiet, Klaus Goergen, Juan José Gómez-Navarro, Juan Jesús González Alemán, Claudia Gutiérrez, José M. Gutiérrez, Ivan Güttler, Andreas Haensler, Tomáš Halenka, Sonia Jerez, Pedro Jiménez-Guerrero, Richard G. Jones, Klaus Keuler, Erik Kjellström, Sebastian Knist, Sven Kotlarski, Douglas Maraun, Erik van Meijgaard, Paola Mercogliano, Juan Pedro Montávez, Antonio Navarra, Grigory Nikulin, Nathalie de Noblet-Ducoudré, Hans-Juergen Panitz, Susanne Pfeifer, Marie Piazza, Emanuela Pichelli, Joni-Pekka Pietikäinen, Andreas F. Prein, Swantje Preuschmann, Diana Rechid, Burkhardt Rockel, Raquel Romera, Enrique Sánchez, Kevin Sieck, Pedro M. M. Soares, Samuel Somot, Lidija Srnec, Silje Lund Sørland, Piet Termonia, Heimo Truhetz, Robert Vautard, Kirsten Warrach-Sagi, Volker Wulfmeyer, Regional climate downscaling over Europe: perspectives from the EURO-CORDEX community, Regional Environmental Change, 10.1007/s10113-020-01606-9, 20, 2, (2020).
- M. N. Legasa, J. M. Gutiérrez, Multisite Weather Generators Using Bayesian Networks: An Illustrative Case Study for Precipitation Occurrence, Water Resources Research, 10.1029/2019WR026416, 56, 7, (2020).
- S. C. Pryor, J. T. Schoof, Differential Credibility Assessment for Statistical Downscaling, Journal of Applied Meteorology and Climatology, 10.1175/JAMC-D-19-0296.1, 59, 8, (1333-1349), (2020).
- Neekita Joshi, Kazi Tamaddun, Ranjan Parajuli, Ajay Kalra, Pankaj Maheshwari, Lorenzo Mastino, Marco Velotta, Future Changes in Water Supply and Demand for Las Vegas Valley: A System Dynamic Approach based on CMIP3 and CMIP5 Climate Projections, Hydrology, 10.3390/hydrology7010016, 7, 1, (16), (2020).
- Joaquín Bedia, Jorge Baño-Medina, Mikel N. Legasa, Maialen Iturbide, Rodrigo Manzanas, Sixto Herrera, Ana Casanueva, Daniel San-Martín, Antonio S. Cofiño, José Manuel Gutiérrez, Statistical downscaling with the downscaleR package (v3.1.0): contribution to the VALUE intercomparison experiment, Geoscientific Model Development, 10.5194/gmd-13-1711-2020, 13, 3, (1711-1735), (2020).
- Jorge Baño-Medina, Rodrigo Manzanas, José Manuel Gutiérrez, Configuration and intercomparison of deep learning neural models for statistical downscaling, Geoscientific Model Development, 10.5194/gmd-13-2109-2020, 13, 4, (2109-2124), (2020).
- Thomas C. M. Martin, Humberto R. Rocha, Gabriel M. P. Perez, Fine scale surface climate in complex terrain using machine learning, International Journal of Climatology, 10.1002/joc.6617, 0, 0, (2020).
- Jie Chen, François P. Brissette, Daniel Caya, Remaining error sources in bias-corrected climate model outputs, Climatic Change, 10.1007/s10584-020-02744-z, (2020).
- Tim van der Schriek, Konstantinos V. Varotsos, Christos Giannakopoulos, Dimitra Founda, Projected Future Temporal Trends of Two Different Urban Heat Islands in Athens (Greece) under Three Climate Change Scenarios: A Statistical Approach, Atmosphere, 10.3390/atmos11060637, 11, 6, (637), (2020).
- Giulia Carella, Mathieu Vrac, Hélène Brogniez, Pascal Yiou, Hélène Chepfer, Statistical downscaling of water vapour satellite measurements from profiles of tropical ice clouds, Earth System Science Data, 10.5194/essd-12-1-2020, 12, 1, (1-20), (2020).
- E. Van Uytven, J. De Niel, P. Meert, V. Wolfs, P. Willems, Fighting big data and ensemble fatigue in climate change impact studies: Can we turn the ensemble cascade upside down?, International Journal of Climatology, 10.1002/joc.6696, 0, 0, (2020).
- John R. Lanzante, Dennis Adams‐Smith, Keith W. Dixon, Maryjo Nath, Carolyn E. Whitlock, Evaluation of some distributional downscaling methods as applied to daily maximum temperature with emphasis on extremes, International Journal of Climatology, 10.1002/joc.6288, 40, 3, (1571-1585), (2019).
- M. Iturbide, J. Bedia, S. Herrera, J. Baño-Medina, J. Fernández, M.D. Frías, R. Manzanas, D. San-Martín, E. Cimadevilla, A.S. Cofiño, J.M. Gutiérrez, The R-based climate4R open framework for reproducible climate data access and post-processing, Environmental Modelling & Software, 10.1016/j.envsoft.2018.09.009, 111, (42-54), (2019).
- Sara C. Pryor, Justin T. Schoof, A hierarchical analysis of the impact of methodological decisions on statistical downscaling of daily precipitation and air temperatures, International Journal of Climatology, 10.1002/joc.5990, 39, 6, (2880-2900), (2019).
- Martin Widmann, Joaquin Bedia, José M. Gutiérrez, Thomas Bosshard, Elke Hertig, Douglas Maraun, María J. Casado, Petra Ramos, Rita M. Cardoso, Pedro M. M. Soares, Jamie Ribalaygua, Christian Pagé, Andreas M. Fischer, Sixto Herrera, Radan Huth, Validation of spatial variability in downscaling results from the VALUE perfect predictor experiment, International Journal of Climatology, 10.1002/joc.6024, 39, 9, (3819-3845), (2019).
- Elke Hertig, Distribution of Anopheles vectors and potential malaria transmission stability in Europe and the Mediterranean area under future climate change, Parasites & Vectors, 10.1186/s13071-018-3278-6, 12, 1, (2019).
- John R. Lanzante, Mary Jo Nath, Carolyn E. Whitlock, Keith W. Dixon, Dennis Adams‐Smith, Evaluation and improvement of tail behaviour in the cumulative distribution function transform downscaling method, International Journal of Climatology, 10.1002/joc.5964, 39, 4, (2449-2460), (2019).
- Christopher Jack, Eleni Katragkou, Evaluation of downscaling methods over Europe: Results of the EU‐COST action VALUE, International Journal of Climatology, 10.1002/joc.6184, 39, 9, (3689-3691), (2019).
- M. Gomez‐Garcia, A. Matsumura, D. Ogawada, K. Takahashi, Time Scale Decomposition of Climate and Correction of Variability Using Synthetic Samples of Stable Distributions, Water Resources Research, 10.1029/2018WR023053, 55, 5, (3632-3658), (2019).
- Katherine S. Zee, Madoka Kumashiro, Investigating mechanisms of social support effectiveness: The case of locomotion motivation, Personal Relationships, 10.1111/pere.12298, 26, 4, (654-679), (2019).
- Orpha Lenne, Laurens Wittevronghel, Laura Vandenbosch, Steven Eggermont, Romantic relationship commitment and the threat of alternatives on social media, Personal Relationships, 10.1111/pere.12299, 26, 4, (680-693), (2019).
- J. Bedia, D. San-Martín, M. Iturbide, S. Herrera, R. Manzanas, J.M. Gutiérrez, The METACLIP semantic provenance framework for climate products, Environmental Modelling & Software, 10.1016/j.envsoft.2019.07.005, (2019).
- B. François, K.E. Schlef, S. Wi, C.M. Brown, Design Considerations for Riverine Floods in a Changing Climate – A Review, Journal of Hydrology, 10.1016/j.jhydrol.2019.04.068, (2019).
- Yi Yang, Jianping Tang, Zhe Xiong, Shuyu Wang, Jian Yuan, An intercomparison of multiple statistical downscaling methods for daily precipitation and temperature over China: present climate evaluations, Climate Dynamics, 10.1007/s00382-019-04809-x, (2019).
- Luzia Keupp, Elke Hertig, Irena Kaspar-Ott, Felix Pollinger, Christoph Ring, Heiko Paeth, Jucundus Jacobeit, Weighted multi-model ensemble projection of extreme precipitation in the Mediterranean region using statistical downscaling, Theoretical and Applied Climatology, 10.1007/s00704-019-02851-7, (2019).
- Ana Casanueva, Sven Kotlarski, Sixto Herrera, Andreas M. Fischer, Tord Kjellstrom, Cornelia Schwierz, Climate projections of a multivariate heat stress index: the role of downscaling and bias correction, Geoscientific Model Development, 10.5194/gmd-12-3419-2019, 12, 8, (3419-3438), (2019).
- Pedro M M Soares, Miguel C Brito, João A M Careto, Persistence of the high solar potential in Africa in a changing climate, Environmental Research Letters, 10.1088/1748-9326/ab51a1, 14, 12, (124036), (2019).
- R. Manzanas, J. M. Gutiérrez, J. Bhend, S. Hemri, F. J. Doblas-Reyes, V. Torralba, E. Penabad, A. Brookshaw, Bias adjustment and ensemble recalibration methods for seasonal forecasting: a comprehensive intercomparison using the C3S dataset, Climate Dynamics, 10.1007/s00382-019-04640-4, (2019).
- Martin Dubrovsky, Radan Huth, Hetal Dabhi, Mathias W. Rotach, Parametric gridded weather generator for use in present and future climates: focus on spatial temperature characteristics, Theoretical and Applied Climatology, 10.1007/s00704-019-03027-z, (2019).
- Gab Abramowitz, Nadja Herger, Ethan Gutmann, Dorit Hammerling, Reto Knutti, Martin Leduc, Ruth Lorenz, Robert Pincus, Gavin A. Schmidt, ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing, Earth System Dynamics, 10.5194/esd-10-91-2019, 10, 1, (91-105), (2019).
- P. M. M. Soares, D. Maraun, S. Brands, M. W. Jury, J. M. Gutiérrez, D. San‐Martín, E. Hertig, R. Huth, A. Belušić Vozila, Rita M. Cardoso, S. Kotlarski, P. Drobinski, A. Obermann‐Hellhund, Process‐based evaluation of the VALUE perfect predictor experiment of statistical downscaling methods, International Journal of Climatology, 10.1002/joc.5911, 39, 9, (3868-3893), (2018).
- Douglas Maraun, Martin Widmann, José M. Gutiérrez, Statistical downscaling skill under present climate conditions: A synthesis of the VALUE perfect predictor experiment, International Journal of Climatology, 10.1002/joc.5877, 39, 9, (3692-3703), (2018).
- A. Reder, M. Iturbide, S. Herrera, G. Rianna, P. Mercogliano, J. M. Gutiérrez, Assessing variations of extreme indices inducing weather-hazards on critical infrastructures over Europe—the INTACT framework, Climatic Change, 10.1007/s10584-018-2184-4, 148, 1-2, (123-138), (2018).
- María Pilar Amblar-Francés, María Asunción Pastor-Saavedra, María Jesús Casado-Calle, Petra Ramos-Calzado, Ernesto Rodríguez-Camino, Strategy for generation of climate change projections feeding Spanish impact community, Advances in Science and Research, 10.5194/asr-15-217-2018, 15, (217-230), (2018).
- Thomas Vandal, Evan Kodra, Auroop R. Ganguly, Intercomparison of machine learning methods for statistical downscaling: the case of daily and extreme precipitation, Theoretical and Applied Climatology, 10.1007/s00704-018-2613-3, (2018).
- Jinmyeong Jeong, Seung-Jae Lee, A Statistical Parameter Correction Technique for WRF Medium-Range Prediction of Near-Surface Temperature and Wind Speed Using Generalized Linear Model, Atmosphere, 10.3390/atmos9080291, 9, 8, (291), (2018).
- Rita M. Cardoso, Pedro M. M. Soares, Daniela C. A. Lima, Pedro M. A. Miranda, Mean and extreme temperatures in a warming climate: EURO CORDEX and WRF regional climate high-resolution projections for Portugal, Climate Dynamics, 10.1007/s00382-018-4124-4, (2018).
- Rasmus E. Benestad, Bob van Oort, Flavio Justino, Frode Stordal, Kajsa M. Parding, Abdelkader Mezghani, Helene B. Erlandsen, Jana Sillmann, Milton E. Pereira-Flores, Downscaling probability of long heatwaves based on seasonal mean daily maximum temperatures, Advances in Statistical Climatology, Meteorology and Oceanography, 10.5194/ascmo-4-37-2018, 4, 1/2, (37-52), (2018).




