Self-supervised Vision

Summary: A lecture covering the basics of self-supervised learning in computer vision.
Topics: Self-supervised learning
Slides: link (pdf)

  • L. B. Smith and M. Gasser, “The Development of Embodied Cognition: Six Lessons from Babies,” Artificial Life (2005)
  • L. B. Smith et al., “The Developing Infant Creates a Curriculum for Statistical Learning”, Trends in Cognitive Sciences (2018)
  • A. M. Turing, “Intelligent Machinery", (1948)
  • H. L. F. Helmholtz, “The Facts in Perception” (1878)
  • H. B. Barlow, "Unsupervised learning", Neural computation (1989)
  • V. R. de Sa, “Learning Classification with Unlabeled Data”, NeurIPS (1993)
  • J. Schmidhuber and S. Heil, “Sequential neural text compression”, IEEE Trans. on Neural Networks (1996)
  • Y. Bengio et al., “A Neural Probabilistic Language Model”, JMLR (2000)
  • T. Mikolov et al. “Efficient Estimation of Word Representations in Vector Space”, ICLR (2013)
  • J. Devlin et al. “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”, NAACL (2019)
  • C. Doersch et al., “Unsupervised Visual Representation Learning by Context Prediction”, ICCV (2015)
  • D. Pathak et al., “Context Encoders: Feature Learning by Inpainting”, CVPR (2016)
  • M. Noroozi and P. Favaro, “Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles”, ECCV (2016)
  • R. Zhang et al., “Colorful Image Colorization”, ECCV (2016)
  • M. Mathieu et al., "Deep multi-scale video prediction beyond mean square error", arXiv preprint arXiv:1511.05440 (2015)
  • M. Noroozi et al., “Representation Learning by Learning to Count”, ICCV (2017)
  • A. Mahendran et al., “Cross Pixel Optical Flow Similarity for Self-Supervised Learning”, ACCV (2018)
  • S. Gidaris et al. “Unsupervised Representation Learning by Predicting Image Rotations”, ICLR (2018)
  • M. Caron et al., “Deep Clustering for Unsupervised Learning of Visual Features”, ECCV (2018)
  • T. Chen et al., "A simple framework for contrastive learning of visual representations", ICML (2020)
  • K. He et al., "Masked autoencoders are scalable vision learners", CVPR (2022)