×

Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. (English) Zbl 1219.93116

Summary: Variance based methods have assessed themselves as versatile and effective among the various available techniques for sensitivity analysis of model output. Practitioners can in principle describe the sensitivity pattern of a model \(Y=f(X_1,X_2,\dots ,X_k)\) with \(k\) uncertain input factors via a full decomposition of the variance \(V\) of \(Y\) into terms depending on the factors and their interactions. More often practitioners are satisfied with computing just \(k\) first order effects and \(k\) total effects, the latter describing synthetically interactions among input factors. In sensitivity analysis a key concern is the computational cost of the analysis, defined in terms of number of evaluations of \(f(X_1,X_2,\dots ,X_k)\) needed to complete the analysis, as \(f(X_1,X_2,\dots ,X_k)\) is often in the form of a numerical model which may take long processing time. While the computational cost is relatively cheap and weakly dependent on \(k\) for estimating first order effects, it remains expensive and strictly \(k\)-dependent for total effect indices. In the present note we compare existing and new practices for this index and offer recommendations on which to use.

MSC:

93E03 Stochastic systems in control theory (general)
93B35 Sensitivity (robustness)

Software:

TOMS659
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Archer, G.; Saltelli, A.; Sobol, I., Sensitivity measures, anova-like techniques and the use of bootstrap, Journal of Statistical Computation and Simulation, 58, 99-120 (1997) · Zbl 1102.62335
[2] Bratley, B.; Fox, B. L.; Niederreiter, H., Implementation and test of low discrepancy sequences, ACM Transactions on Modeling and Computer Simulation, 2, 3, 195-213 (1992) · Zbl 0846.11044
[3] Bratley, P.; Fox, B. L., Algorithm 659 implementing Sobol’s quasirandom sequence generator, ACM Transactions on Mathematical Software, 14, 1, 88-100 (1988) · Zbl 0642.65003
[4] Campolongo, F.; Cariboni, J.; Saltelli, A., An effective screening design for sensitivity analysis of large models, Environmental Modelling and Software, 22, 1509-1518 (2007)
[5] Chan, K.; Saltelli, A.; Tarantola, S., Winding stairs: A sampling tool to compute sensitivity indices, Statistics and Computing, 10, 187-196 (2000)
[6] Cukier, R. I.; Fortuin, C. M.; Schuler, K. E.; Petschek, A. G.; Schaibly, J. H., Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. \(i\) theory, The Journal of Chemical Physics, 59, 3873-3878 (1973)
[7] p. 24, accessed April 10, 2009
[8] Efron, B.; Stein, C., The jackknife estimate of variance, Annals of Statistics, 9, 586-596 (1981) · Zbl 0481.62035
[9] p. 26, accessed April 10 2009
[10] Helton, J.; Johnson, J.; Sallaberry, C.; Storlie, C., Survey of sampling-based methods for uncertainty and sensitivity analysis, Reliability Engineering and System Safety, 91, 10-11, 1175-1209 (2006)
[11] Homma, T.; Saltelli, A., Importance measures in global sensitivity analysis of model output, Reliability Engineering and System Safety, 52, 1, 1-17 (1996)
[12] T. Ishigami and T. Homma, An importance qualification technique in uncertainty analysis for compute models, in: Proceedings of the Isuma ’90. First International Symposium on Uncertainty Modelling and Analysis, University of Maryland, 3-5 December 1996; T. Ishigami and T. Homma, An importance qualification technique in uncertainty analysis for compute models, in: Proceedings of the Isuma ’90. First International Symposium on Uncertainty Modelling and Analysis, University of Maryland, 3-5 December 1996
[13] Jacques, J.; Lavergne, C.; Devictor, N., Analysis in presence of model uncertainty and correlate inputs, Reliability Engineering and System Safety, 91, 1126-1134 (2006)
[14] Jansen, M. J.W., Analysis of variance designs for model output, Computer Physics Communications, 117, 35-43 (1999) · Zbl 1015.68218
[15] Jansen, M. J.W.; Rossing, W. A.H.; Daamen, R. A., Monte Carlo estimation of uncertainty contributions from several independent multivariate sources, (Gasmanand, J.; van Straten, G., Predictability and Nonlinear Modelling in Natural Sciences and Economics (1994), Kluwer Academic Publishers: Kluwer Academic Publishers Dordrecht), 334-343 · Zbl 0875.65019
[16] S. Kucherenko, Imperial College, London, 2009, personal communication; S. Kucherenko, Imperial College, London, 2009, personal communication
[17] Kucherenko, S.; Rodriguez-Fernandez, M.; Pantelides, C.; Shah, N., Monte Carlo evaluation of derivative-based global sensitivity measures, Reliability Engineering and System Safety, 94, 1135-1148 (2009)
[18] Mood, A. M.; Graybill, F. A.; Boes, D. C., Introduction to the Theory of Statistics (1974), McGraw-Hill · Zbl 0277.62002
[19] Morris, M. D., Factorial sampling plans for preliminary computational experiments, Technometrics, 33, 2, 161-174 (1991)
[20] Oakley, J. E.; O’Hagan, A., Probabilistic sensitivity analysis of complex models: A Bayesian approach, Journal of the Royal Statistical Society B, 66, 751-769 (2004) · Zbl 1046.62027
[21] pp. 16-17, accessed April 10, 2009
[22] Rabitz, H.; Aliş, Ö. F.; Shorter, J.; Shim, K., Efficient input-output model representations, Computer Physics Communications, 117, 11-20 (1999) · Zbl 1015.68219
[23] Ratto, M.; Pagano, A.; Young, P., State dependent parameter metamodelling and sensitivity analysis, Computer Physics Communications, 177, 863-876 (2007)
[24] Sacks, J.; Welch, W.; Mitchell, T.; Wynn, H., Design and analysis of computer experiments, Statistical Science, 4, 409-435 (1989) · Zbl 0955.62619
[25] Saltelli, A., Making best use of model valuations to compute sensitivity indices, Computer Physics Communications, 145, 280-297 (2002) · Zbl 0998.65065
[26] Saltelli, A.; Campolongo, F.; Cariboni, J., Screening important inputs in models with strong interaction properties, Reliability Engineering and System Safety, 94, 7, 1149-1155 (2009)
[27] (Saltelli, A.; Chan, K.; Scott, M., Sensitivity Analysis. Sensitivity Analysis, Probability and Statistics Series (2000), John Wiley and Sons) · Zbl 0961.62091
[28] Saltelli, A.; Ratto, M.; Andres, T.; Campolongo, F.; Cariboni, J.; Gatelli, D.; Saisana, M.; Tarantola, S., Global Sensitivity Analysis. The Primer (2008), John Wiley and Sons · Zbl 1161.00304
[29] Saltelli, A.; Ratto, M.; Tarantola, S.; Campolongo, F., Sensitivity analysis for chemical models, Chemical Reviews, 105, 7, 2811-2828 (2005)
[30] Saltelli, A.; Sobol’, I. M., About the use of rank transformation in sensitivity analysis of model output, Reliability Engineering and System Safety, 50, 225-239 (1995)
[31] Saltelli, A.; Tarantola, S., On the relative importance of input factors in mathematical models: Safety assessment for nuclear waste disposal, Journal of American Statistical Association, 97, 702-709 (2002) · Zbl 1073.62602
[32] Saltelli, A.; Tarantola, S.; Campolongo, F., Sensitivity analysis as an ingredient of modelling, Statistical Science, 15, 4, 377-395 (2000)
[33] Saltelli, A.; Tarantola, S.; Chan, K., Quantitative model-independent method for global sensitivity analysis of model output, Technometrics, 41, 1, 39-56 (1999)
[34] Santner, T. J.; Williams, B. J.; Notz, W. I., Design and Analysis of Computer Experiments (2003), Springer-Verlag · Zbl 1041.62068
[35] Sobol’, I. M., On the distribution of points in a cube and the approximate evaluation of integrals, USSR Comput. Maths. Math. Phys., 7, 86-112 (1967) · Zbl 0185.41103
[36] Sobol’, I. M., Uniformly distributed sequences with an addition uniform property, USSR Comput. Maths. Math. Phys., 16, 236-242 (1976) · Zbl 0391.10033
[37] Sobol’, I. M., Sensitivity estimates for nonlinear mathematical models, Matematicheskoe Modelirovanie, 2, 112-118 (1990), Translated from Russian: · Zbl 0974.00506
[38] Sobol’, I. M., Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Mathematics and Computers in Simulation, 55, 271-280 (2001) · Zbl 1005.65004
[39] Sobol’, I. M., Global sensitivity analysis indices for the investigation of nonlinear mathematical models, Matematicheskoe Modelirovanie, 19, 11, 23-24 (2007), (in Russian) · Zbl 1140.60323
[40] Sobol’, I. M.; Kucherenko, S., On global sensitivity analysis of quasi-Monte Carlo algorithms, Monte Carlo Methods and Applications, 11, 1, 1-9 (2005) · Zbl 1072.65004
[41] Sobol’, I. M.; Tarantola, S.; Gatelli, D.; Kucherenko, S.; Mauntz, W., Estimating the approximation error when fixing unessential factors in global sensitivity analysis, Reliability Engineering and System Safety, 92, 7, 957-960 (2007)
[42] Sobol’, I. M.; Turchaninov, S.; Levitan, V.; Shukhman, B. V., Quasirandom sequence generators, Keldysh Inst. Appl. Maths RAS Acad. Sci. (1992)
[43] Storlie, C. B.; Helton, J. C., Multiple predictor smoothing methods for sensitivity analysis: Description of techniques, Reliability Engineering and System Safety, 93, 28-54 (2007)
[44] Storlie, C. B.; Swiler, L. P.; Helton, J. C.; Sallaberry, C. J., Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models, Reliability Engineering and System Safety, 94, 1735-1763 (2009)
[45] Tarantola, S.; Gatelli, D.; Mara, T., Random balance designs for the estimation of first order global sensitivity indices, Reliability Engineering and System Safety, 91, 6, 717-727 (2006)
[46] S. Da Veiga, F. Wahl, F. Gamboa, Local polynomial estimation for sensitivity analysis for models with correlated inputs, Technometrics, 2009, in press; S. Da Veiga, F. Wahl, F. Gamboa, Local polynomial estimation for sensitivity analysis for models with correlated inputs, Technometrics, 2009, in press
[47] Volkova, E.; Iooss, B.; Van Dorpe, F., Global sensitivity analysis for a numerical model of radionuclide migration from the RC “Kurchatov institute” radwaste disposal site, Stochastic Environmental Research and Risk Assessment, 22, 17-31 (2008) · Zbl 1169.62399
[48] Xu, C.; Gertner, G. Z., A general first-order global sensitivity analysis method, Reliability Engineering and System Safety, 93, 1060-1071 (2008)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.