Université Paris 6
Pierre et Marie Curie
Université Paris 7
Denis Diderot

CNRS U.M.R. 7599
``Probabilités et Modèles Aléatoires''

A PAC-Bayesian approach to adaptive classification


Code(s) de Classification MSC:

Résumé: This is meant to be a self-contained presentation of adaptive classification seen from the PAC-Bayesian point of view. Although most of the results are original, some review materials about the VC dimension and support vector machines are also included. This study falls in the field of statistical learning theory, where complex data have to be analyzed from a limited amount of informations, drawn from a finite sample. It relies on non asymptotic deviation inequalities, where the complexity of models is captured through the use of prior measures. The main improvements brought here are more {\em localized} bounds and the use of {\em exchangeable} prior distributions. Interesting consequences are drawn for the generalization properties of support vector machines and the design of new classification algorithms.

Mots Clés: Statistical learning theory ; adaptive statistics ; pattern recognition ; PAC-Bayesian theorems ; VC dimension ; fat shattering dimension ; localized complexity bounds ; randomized estimators ; Support Vector Machines ; compression schemes ; margin bounds

Date: 2003-09-05

Prépublication numéro: PMA-840