Advanced Search

Query:

Fill in the form and click »Search«...

Format:

Display: entries per page entries

Zbl 0997.68109
Tipping, Michael E.
Sparse Bayesian learning and the relevance vector machine. (English)
[J] J. Mach. Learn. Res. 1, No.3, 211-244 (2001). ISSN 1532-4435; ISSN 1533-7928/e

Summary: This paper introduces a general Bayesian framework for obtaining sparse solutions to regression and classification tasks utilizing models linear in the parameters. Although this framework is fully general, we illustrate our approach with a particular specialization that we denote the `Relevance Vector Machine' (RVM), a model of identical functional form to the popular and state-of-the-art `Support Vector Machine' (SVM). We demonstrate that by exploiting a probabilistic Bayesian learning framework, we can derive accurate prediction models which typically utilize dramatically fewer basis functions than a comparable SVM while offering a number of additional advantages. These include the benefits of probabilistic predictions, automatic estimation of `nuisance' parameters, and the facility to utilize arbitrary basis functions (e.g. non-`Mercer' kernels).\par We detail the Bayesian framework and associated learning algorithm for the RVM, and give some illustrative examples of its application along with some comparative benchmarks. We offer some explanation for the exceptional degree of sparsity obtained, and discuss and demonstrate some of the advantageous features, and potential extensions, of Bayesian relevance learning.

MSC 2000:: *68T05 Learning and adaptive systems

Keywords: support vector machine

Cited in: Zbl 1226.62019

Comment on this Item PDF MathML XML ASCII DVI PS BibTeX Online Ordering Article Journal

	Scientific prize winners of the ICM 2010
	Overhang
	Lie groups, physics and geometry. An introduction for physicists, engineers and chemists.

Advanced Search

Zentralblatt MATH Berlin [Germany]