A sensitivity analysis of the PAWN sensitivity index
Abstract
The PAWN index is gaining traction among the modelling community as a sensitivity measure. However, the robustness to its design parameters has not yet been scrutinized: the size (N) and sampling (ε) of the model output, the number of conditioning intervals (n) or the summary statistic (θ). Here we fill this gap by running a sensitivity analysis of a PAWN-based sensitivity analysis. We compare the results with the design uncertainties of the Sobol' total-order index (STi∗). Unlike in STi∗ , the design uncertainties in PAWN create non-negligible chances of producing biased results when ranking or screening inputs. The dependence of PAWN upon (N , n , ε , θ) is difficult to tame, as these parameters interact with one another. Even in an ideal setting in which the optimum choice for (N , n , ε , θ) is known in advance, PAWN might not allow to distinguish an influential, non-additive model input from a truly non-influential model input.
- Publication:
-
Environmental Modelling & Software
- Pub Date:
- May 2020
- DOI:
- 10.1016/j.envsoft.2020.104679
- arXiv:
- arXiv:1904.04488
- Bibcode:
- 2020EnvMS.12704679P
- Keywords:
-
- Uncertainty;
- Environmental modelling;
- Statistics;
- Risk;
- Statistics - Applications;
- Statistics - Computation
- E-Print:
- The paper has been accepted for publication in Environmental Modeling and Software (use the journal version to cite the paper)