2022 - T3 - WS1 - Non-Linear and High Dimensional Inference

Collection 2022 - T3 - WS1 - Non-Linear and High Dimensional Inference

Organisateur(s) Aamari, Eddie ; Aaron, Catherine ; Chazal, Frédéric ; Fischer, Aurélie ; Hoffmann, Marc ; Le Brigant, Alice ; Levrard, Clément ; Michel, Bertrand

Date(s) 03/10/2022 - 07/10/2022

URL associée https://indico.math.cnrs.fr/event/7545/

11 21

Stein effect for estimating many vector means: a "blessing of dimensionality" phenomenon

De Gilles Blanchard

Consider the problem of joint estimation of the means for a large number of distributions in $R^d$ using separate, independent data sets from each of them, sometimes also called "multi-task averaging" problem. We propose an improved estimator (compared to the naive empirical means of each data set) to exploit possible similarities between means, without any related information being known in advance. First, for each data set, similar or neighboring means are determined from the data by multiple testing. Then each naive estimator is shrunk towards the local average of its neighbors. We prove that this approach provides a reduction in mean squared error that can be significant when the (effective) dimensionality of the data is large, and when the unknown means exhibit structure such as clustering or concentration on a low-dimensional set. This is directly linked to the fact that the separation distance for testing is smaller than the estimation error in high dimension and generalizes the well-known James-Stein phenomenon. An application of this approach is the estimation of multiple kernel mean embeddings, which plays an important role in many modern applications.

(This is based on joined work with Hannah Marienwald and Jean-Baptiste Fermanian)

Informations sur la vidéo

Date de captation 06/10/2022
Date de publication 29/04/2024
Institut IHP
Langue Anglais
Audience Chercheurs, Doctorants
Réalisateur(s) Alexandre Duplessis, Marco Perez
Format MP4
Lieu Amphitheater Hermite, IHP

Données de citation

DOI 10.57987/IHP.2022.T3.WS1.011
Citer cette vidéo Blanchard, Gilles (06/10/2022). Stein effect for estimating many vector means: a "blessing of dimensionality" phenomenon. IHP. Audiovisual resource. DOI: 10.57987/IHP.2022.T3.WS1.011
URL https://dx.doi.org/10.57987/IHP.2022.T3.WS1.011

Domaine(s)

Statistiques - Théorie

Bibliographie

H. Marienwald, J-B. Fermanian, G. Blanchard / High-Dimensional Multi-Task Averaging and Application to Kernel Mean Embedding. Artificial Intelligence and Statistics (AISTATS 2021)

Codes MSC

62-XX STATISTICS

Dernières questions liées sur MathOverflow

Pour poser une question, votre compte Carmin.tv doit être connecté à mathoverflow

Poser une question sur MathOverflow

Toutes les vidéos de la collection

Scaling ResNets in the Large-depth Regime

De Adeline Fermanian

Overcoming the curse of dimensionality with deep neural networks

De Sophie Langer

Learning on and near Low-Dimensional Subsets of the Wasserstein Manifold

De Alex Cloninger

Extrinsic and Intrinsic Operator Estimations for Manifold Learning

De John Harlim

A graph coupling view of dimension reduction

De Franck Picard

Topologically penalized regression on manifolds

De Wolfgang Polonik

Bayesian nonparametric estimation of a density living near an unknown manifold

De Judith Rousseau

Linear methods for non-linear inverse problems

De Botond Szabo

Convergence of Sharpness-Aware Minimization

De Peter Bartlett

Dimensionality reduction in reinforcement learning by randomisation

De Denis Belomestny

Stein effect for estimating many vector means: a "blessing of dimensionality" phenomenon

De Gilles Blanchard

On the use of overfitting for estimator selection

De Claire Lacour

Optimal Permutation estimation in crowdsourcing problems

De Nicolas Verzelen

What does LIME really see in images?

De Damien Garreau

A statistical analysis of an image classification problem

De Johannes Schmidt-Hieber

Learning a partial correlation graph using only a few covariance queries

De Vasiliki Velona

publiée le 5 avril 2024

Neural networks, wide and deep, singular kernels and Bayes optimality

De Mikhail Belkin

publiée le 5 avril 2024

Understanding the geometry of high-dimensional data through the reach

De Clément Bérenfeld

publiée le 5 avril 2024

Manifold Learning, Explanations and Eigenflows - Part 1

De Marina Meila

publiée le 5 avril 2024

Manifold Learning, Explanations and Eigenflows - Part 2

De Cécile Mailler

publiée le 5 avril 2024

On high-dimensional Lévy-driven Ornstein-Uhlenbeck processes

De Claudia Strauch

Copyright Carmin.tv 2024

Donner son avis