11e Journée Statistique et Informatique pour la Science des Données à Paris-Saclay

Collection 11e Journée Statistique et Informatique pour la Science des Données à Paris-Saclay

Organisateur(s) Avetik Karagulyan, Erwan Le Pennec
Date(s) 03/04/2026 - 03/04/2026
URL associée https://indico.math.cnrs.fr/event/16080/
00:00:00 / 00:00:00
4 6

Asymptotic Theory of Iterated Empirical Risk Minimization, with Applications to Active Learning

De Hugo Cui

We study a class of iterated empirical risk minimization (ERM) procedures in which two successive ERMs are performed on the same dataset, and the predictions of the first estimator enter as an argument in the loss function of the second. This setting, which arises naturally in active learning and reweighting schemes, introduces intricate statistical dependencies across samples and fundamentally distinguishes the problem from classical single-stage ERM analyses. For linear models trained with a broad class of convex losses on Gaussian mixture data, we derive a sharp asymptotic characterization of the test error in the high-dimensional regime where the sample size and ambient dimension scale proportionally. Our results provide explicit, fully asymptotic predictions for the performance of the second-stage estimator despite the reuse of data and the presence of prediction-dependent losses. We apply this theory to revisit a well-studied pool-based active learning problem, removing oracle and sample-splitting assumptions made in prior work. We uncover a fundamental tradeoff in how the labeling budget should be allocated across stages, and demonstrate a double-descent behavior of the test error driven purely by data selection, rather than model size or sample count. Based on joint work with Yue M Lu.

Informations sur la vidéo

  • Date de captation 03/04/2026
  • Date de publication 13/04/2026
  • Institut IHES
  • Langue Anglais
  • Audience Chercheurs
  • Format MP4

Dernières questions liées sur MathOverflow

Pour poser une question, votre compte Carmin.tv doit être connecté à mathoverflow

Poser une question sur MathOverflow




Inscrivez-vous

  • Mettez des vidéos en favori
  • Ajoutez des vidéos à regarder plus tard &
    conservez votre historique de consultation
  • Commentez avec la communauté
    scientifique
  • Recevez des notifications de mise à jour
    de vos sujets favoris
Donner son avis