Air Quality PM2.5 Data Validation: Techniques, Challenges, and Good Practices
Abstract
Speciated particulate matter (PM) data is used to evaluate short- and long-term air quality trends, as well as to identify and quantify sources to inform emission reduction strategies that may impact human health. Thorough data validation is necessary to ensure data are meaningful and of high quality.
Data from large air quality networks often follow a complex pathway involving multiple field operators, laboratories, and data handlers, with each step potentially introducing error. Data validation must occur at multiple levels to identify potential data quality issues such as contamination, sample mishandling, instrument malfunctions, and analytical problems. Here we describe validation processes and good practices, with the U.S. Environmental Protection Agency Chemical Speciation Network (CSN) as an example, using data quality assurance methods to identify outliers, short- and long-term biases, atmospheric phenomenon, and real events such as industrial emissions, fireworks, and dust storms that influence PM. We also discuss validation methods for comparison of related species from different analytical laboratories, external data, and application of automated checks for management of large datasets. Validation processes continue to evolve, with relational databases, automation of various checks using programming, and other technical advances that improve the efficiency and consistency of quality assurance practices. Leveraging modern data handling tools - and increasing understanding and access both for validators, analysts, general data users - for large data sets is an ongoing challenge, and it is important to share tools, techniques, and experiences within the air quality community and other disciplines to maximize potential for high-quality data.- Publication:
-
AGU Fall Meeting Abstracts
- Pub Date:
- December 2018
- Bibcode:
- 2018AGUFM.A13I2553Y
- Keywords:
-
- 0305 Aerosols and particles;
- ATMOSPHERIC COMPOSITION AND STRUCTUREDE: 0345 Pollution: urban and regional;
- ATMOSPHERIC COMPOSITION AND STRUCTUREDE: 0394 Instruments and techniques;
- ATMOSPHERIC COMPOSITION AND STRUCTUREDE: 3394 Instruments and techniques;
- ATMOSPHERIC PROCESSES