WG1 - Assessment
Lead: VITO Co-lead: JRC Co-ordinator: S. Janssen
In this WG a methodology to benchmark model performances according to a common scale and common template has been the focus for several years.
In this context, model quality objectives (MQO) based on observation uncertainty have been discussed and the methodology is consolidated in the so-called DELTA tool. Currently the methodology is extensively tested by the FAIRMODE community.
Time is also devoted to extend the methodology to other pollutants and assess its robustness for various model applications and various scales. One output of this process is a finalized methodology together with updated model quality objectives for the main pollutants (i.e. how to fix a minimum level of quality for model results to be used in the policy context).
In addition to model performance, a few other relevant topics are addressed within this WG1:
1 The combined use of modeling and monitoring data is a crucial (cross-cutting) topic in this WG1. At present it is commonly accepted that any model application for assessment purposes to some extent should make use of monitoring data. This can be via (complex) data assimilation techniques or more simple bias corrections. However, in such combined approaches, it is not straightforward anymore to validate the output and common procedures have to be established to propose an independent model evaluation;
2 Spatial representativeness of monitoring stations has been investigated and discussed intensively in the past by a FAIRMODE subgroup 5 . No well-established procedure has been identified so far. Also in the scientific literature, there is no agreement to tackle this complex problem. FAIRMODE has initiated a survey of existing methodologies in the EU and is preparing an intercomparison exercise;
3 A longstanding open issue is the use of model output in formal reporting by Member States. As a matter of fact, many regions and member states are using models in their day-to-day air quality management activities, but apparently only very few of them actually use those results in the formal reporting procedures at the EU-level. FAIRMODE explores current practices to understand the objections and obstructions in this process. Based on those findings, recommendations have been drafted to stimulate the use of models for air quality management and the formal reporting;
Applying the Delta tool to support AQD: The validation of the TCAM chemical transport model, C. Carnevale, G. Finzi, A. Pederzoli, E.Pisoni, P. Thunis, E.Turrini, M.Volta, Air Quality, Atmosphere and Health , 10.1007/s11869-014-0240-4, 2014
Model quality objectives based on measurement uncertainty. Part I: Ozone, P. Thunis, D. Pernigotti and M. Gerboles, 2013. Atmospheric Environment, 79 (2013) 861-868.
Model quality objectives based on measurement uncertainty. Part I: PM10 and NO2, D. Pernigotti, P. Thunis, C. Belis and M. Gerboles, 2013. Atmospheric Environment, 79 (2013) 869-878.
Performance criteria to evaluate air quality modeling applications, P. Thunis, A. Pederzoli, D. Pernigotti. Atmospheric Environment, 59, 476-482, 2012.
A tool to evaluate air quality model performances in regulatory applications, P. Thunis, E. Geogieva, A. Pederzoli, Environmental Modelling & Software, 38, 220-230, 2012