Determing Credibility of Regional Simulations of Future Climate

Climate models have been evaluated or validated ever since they were first developed. Establishing that a climate model can reproduce (some) aspects of the current climate of the earth on various spatial and temporal scales has long been a standard procedure for providing confidence in the model's ability to simulate future climate. However, direct links between the successes and failures of models in reproducing the current climate with regard to what future climates the models simulate has been largely lacking. This is to say that the model evaluation process has been largely divorced from the projections of future climate that the models produce. This is evidenced in the separation in the Intergovernmental Panel on Climate Change (IPCC) WG1 report of the chapter on evaluation of models from the chapter on future climate projections. There has also been the assumption of 'one model, one vote, that is, that each model projection is given equal weight in any multi-model ensemble presentation of the projections of future climate. There have been various attempts at determing measures of credibility that would avoid the 'ultrademocratic' assumption of the IPCC. Simple distinctions between models were made by research such as in Giorgi and Mearns (2002), Tebaldi et al., (2005), and Greene et al., (2006). But the metrics used were rather simplistic. More ambitous means of discriminating among the quality of model simulations have been made through the production of complex multivariate metrics, but insufficent work has been produced to verify that the metrics successfully discriminate in meaningful ways. Indeed it has been suggested that we really don't know what a model must successfully model to establish confidence in its regional-scale projections (Gleckler et al., 2008). Perhaps a more process oriented regional expert judgment approach is needed to understand which errors in climate models really matter for the model's response to future forcing. Such an approach is being attempted in the North American Climate Change Assessment Program (NARCCAP) whereby multiple global models are used to drive multiple regional models for the current period and the mid-21st century over the continent. Progress in this endeavor will be reported.