Meeting in Mathematical Statistics: Statistical thinking in the age of AI : robustness, fairness and privacy / Rencontre de Statistique Mathématique

Collection Meeting in Mathematical Statistics: Statistical thinking in the age of AI : robustness, fairness and privacy / Rencontre de Statistique Mathématique

Organizer(s) Klopp, Olga ; Ndaoud, Mohamed ; Pouet, Christophe ; Rakhlin, Alexander
Date(s) 18/12/2023 - 22/12/2023
linked URL https://conferences.cirm-math.fr/3087.html
00:00:00 / 00:00:00
2 5

Minimax estimation in Efron's two-groups model

By Chao Gao

The advent of large scale inference has spurred reexamination of conventional statistical thinking. In a series of highly original articles, Efron showed in some examples that the ensemble of the null distributed test statistics grossly deviated from the theoretical null distribution, and Efron persuasively illustrated the danger in assuming the theoretical null's veracity for downstream inference. Though intimidating in other contexts, the large scale setting is to the statistician's benefit here. There is now potential to estimate, rather than assume, the null distribution. In a model for n many z-scores with at most k nonnulls, we adopt Efron's suggestion and consider estimation of location and scale parameters for a Gaussian null distribution. Placing no assumptions on the nonnull effects, we consider rate-optimal estimation in the entire regime k < n/2, that is, precisely the regime in which the null parameters are identifiable. The minimax upper bound is obtained by considering estimators based on the empirical characteristic function and the classical kernel mode estimator. Faster rates than those in Huber's contamination model are achievable by exploiting the Gaussian character of the data. As a consequence, it is shown that consistent estimation is indeed possible in the practically relevant regime k ≍ n. In a certain regime, the minimax lower bound involves constructing two marginal distributions whose characteristic functions match on a wide interval containing zero. The construction notably differs from those in the literature by sharply capturing a second-order scaling of n/2 − k in the minimax rate.

Information about the video

  • Date of recording 18/12/2023
  • Date of publication 08/01/2024
  • Institution CIRM
  • Licence CC BY NC ND
  • Language English
  • Director(s) Luca Recanzone
  • Format MP4

Citation data

  • DOI 10.24350/CIRM.V.20120403
  • Cite this video Gao, Chao (18/12/2023). Minimax estimation in Efron's two-groups model. CIRM. Audiovisual resource. DOI: 10.24350/CIRM.V.20120403
  • URL https://dx.doi.org/10.24350/CIRM.V.20120403

Domain(s)

Last related questions on MathOverflow

You have to connect your Carmin.tv account with mathoverflow to add question

Ask a question on MathOverflow




Register

  • Bookmark videos
  • Add videos to see later &
    keep your browsing history
  • Comment with the scientific
    community
  • Get notification updates
    for your favorite subjects
Give feedback