×

Prediction intervals for neural networks via nonlinear regression. (English) Zbl 1063.62582

Summary: Standard methods for computing prediction intervals in nonlinear regression can be effectively applied to neural networks when the number of training points is large. Simulations show, however, that these methods can generate unreliable prediction intervals on smaller datasets when the network is trained to convergence. Stopping the training algoritm prior to convergence, to avoid overfitting, reduces the effective number of parameters but can lead to prediction intervals that are too wide. We present an alternative approach to estimating prediction intervals using weight decay to fit the network and show via a simulation study that this method may be effective in overcoming some of the shortcomings of the other approaches.

MSC:

62M45 Neural nets and related approaches to inference from stochastic processes
62G08 Nonparametric regression and quantile regression
62M20 Inference from stochastic processes and prediction
PDFBibTeX XMLCite
Full Text: DOI