A statistical analysis of an image classification problem

By Johannes Schmidt-Hieber

Appears in collection : 2022 - T3 - WS1 - Non-Linear and High Dimensional Inference

The availability of massive image databases resulted in the development of scalable machine learning methods such as convolutional neural network (CNNs) filtering and processing these data. While the very recent theoretical work on CNNs focuses on standard nonparametric denoising problems, the variability in image classification datasets does, however, not originate from additive noise but from variation of the shape and other characteristics of the same object across different images. To address this problem, we consider a simple supervised classification problem for object detection on grayscale images. While from the function estimation point of view, every pixel is a variable and large images lead to high-dimensional function recovery tasks suffering from the curse of dimensionality, increasing the number of pixels in our image deformation model enhances the image resolution and makes the object classification problem easier. We propose and theoretically analyze two different procedures. The first method estimates the image deformation by support alignment. Under a minimal separation condition, it is shown that perfect classification is possible. The second method fits a CNN to the data. We derive a rate for the misclassification error depending on the sample size and the number of pixels. Both classifiers are empirically compared on images generated from the MNIST handwritten digit database. The obtained results corroborate the theoretical findings.

Information about the video

Citation data

  • DOI 10.57987/IHP.2022.T3.WS1.015
  • Cite this video Schmidt-Hieber Johannes (10/7/22). A statistical analysis of an image classification problem. IHP. Audiovisual resource. DOI: 10.57987/IHP.2022.T3.WS1.015
  • URL https://dx.doi.org/10.57987/IHP.2022.T3.WS1.015



  • Sophie Langer, Johannes Schmidt-Hieber / A statistical analysis of an image classification problem arXIv:2206.02151

MSC codes

Last related questions on MathOverflow

You have to connect your Carmin.tv account with mathoverflow to add question

Ask a question on MathOverflow


  • Bookmark videos
  • Add videos to see later &
    keep your browsing history
  • Comment with the scientific
  • Get notification updates
    for your favorite subjects
Give feedback