Meeting in Mathematical Statistics - Machine learning and nonparametric statistics / Rencontres de statistique mathématique

Collection Meeting in Mathematical Statistics - Machine learning and nonparametric statistics / Rencontres de statistique mathématique

Organisateur(s) Butucea, Cristina ; Minsker, Stanislav ; Pouet, Christophe ; Spokoiny, Vladimir

Date(s) 13/12/2021 - 17/12/2021

URL associée https://conferences.cirm-math.fr/2581.html

00:00:00 / 00:00:00

1 4

Benign overfitting - Lecture 1

De Peter Bartlett

These lectures present some recent results on two phenomena that have been observed in deep neural networks. The first is benign overfitting: even without any explicit effort to control model complexity, deep learning methods find functions that give a near-perfect fit to noisy training data and yet exhibit good prediction performance in practice. We describe results that characterize this phenomenon in linear regression and in ridge regression. The second phenomenon that we consider is that of adversarial examples: functions computed by deep networkscan be extremely sensitive to small changes in their inputs. We show that this occurs in ReLU networks of constant depth with independent gaussian parameters because the functions that these networks compute are close to linear. The lectures include joint work with Seb Bubeck, Yeshwanth Cherapanamjeri, Phil Long, Gabor, Lugosi, and Alex Tsigler.

Informations sur la vidéo

Date de captation 14/12/2021
Date de publication 14/01/2022
Institut CIRM
Licence CC BY NC ND
Langue Anglais
Audience Chercheurs
Réalisateur(s) Guillaume Hennenfent
Format MP4

Données de citation

DOI 10.24350/CIRM.V.19867403
Citer cette vidéo Bartlett, Peter (14/12/2021). Benign overfitting - Lecture 1. CIRM. Audiovisual resource. DOI: 10.24350/CIRM.V.19867403
URL https://dx.doi.org/10.24350/CIRM.V.19867403

Domaine(s)

Apprentissage

Bibliographie

BARTLETT, Peter L., LONG, Philip M., LUGOSI, Gábor, et al. Benign overfitting in linear regression. Proceedings of the National Academy of Sciences, 2020, vol. 117, no 48, p. 30063-30070. - https://arxiv.org/abs/1906.11300
BARTLETT, Peter L., LONG, Philip M., LUGOSI, Gábor, et al. Benign overfitting in linear regression. Proceedings of the National Academy of Sciences, 2020, vol. 117, no 48, p. 30063-30070. - https://arxiv.org/abs/2009.14286
BARTLETT, Peter L. et LONG, Philip M. Failures of model-dependent generalization bounds for least-norm interpolation. arXiv preprint arXiv:2010.08479, 2020. - https://arxiv.org/abs/2010.08479
BARTLETT, Peter L., MONTANARI, Andrea, et RAKHLIN, Alexander. Deep learning: a statistical viewpoint. arXiv preprint arXiv:2103.09177, 2021. - https://arxiv.org/abs/2103.09177

Dernières questions liées sur MathOverflow

Pour poser une question, votre compte Carmin.tv doit être connecté à mathoverflow

Poser une question sur MathOverflow

Toutes les vidéos de la collection

01:08:14

publiée le 14 janvier 2022

Benign overfitting - Lecture 1

De Peter Bartlett

53:47

publiée le 14 janvier 2022

High dimensional mean estimation - Lecture 2

De Gábor Lugosi

54:38

publiée le 14 janvier 2022

Adversarial examples in deep networks - Lecture 2

De Peter Bartlett

55:11

publiée le 14 janvier 2022

Network archeology: a few results and questions - Lecture 1

De Gábor Lugosi

Copyright Carmin.tv 2024

Donner son avis