Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Samuel Albanie

Posts

digests

Big O notation: Samuel’s guide

Summary: Samuel's tutorial on big O notation and other asymptotic notation (little o, big theta, big omega, little omega).
Topics: Complexity, data structures, algorithms, analysis
Date: October, 2022
[slides]

ReCo: Retrieve and Co-segment for Zero-Shot Transfer

Summary: A short description of the ReCo framework introduced in the work 'ReCo: Retrieve and Co-segment for Zero-shot Transfer' by G. Shin, W. Xie and S. Albanie, published at NeurIPS in 2022.
Topics: semantic segmentation, foundation models, zero shot transfer
Date: October, 2022
[slides]

Scaling Instruction-Finetuned Language Models (Flan-PaLM)

Summary: A description of the the work 'Scaling Instruction-Finetuned Language Models' by Hyung Won Chung et al. published on arxiv in October 2022. This work introduced the Flan-PaLM 540B model.
Topics: instruction finetuning, foundation models, large language models
Date: October, 2022
[slides]

Crosslingual Generalization through Multitask Finetuning (BLOOMZ & mT0)

Summary: A description of the the work 'Crosslingual Generalization through Multitask Finetuning' by Niklas Muennighoff et al. published on arxiv in November 2022 as part of the BigScience Workshop. This work introduced the BLOOMZ and mT0 models.
Topics: multitask finetuning, foundation models, large language models, multilingual models
Date: November, 2022
[slides]

B-trees: Samuel’s guide

Summary: Samuel's tutorial on the B-tree data structure.
Topics: B-trees, data structures, algorithms, coding
Date: December, 2022
[slides]

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Summary: A description of the the work 'BLOOM: A 176B-Parameter Open-Access Multilingual Language Model' by Le Scao et al. published on arxiv in November 2022 as part of the BigScience Workshop. This work provides an overview of the BLOOM model and the efforts involved in its creation.
Topics: foundation models, large language models, multilingual models
Date: January, 2023
[slides]

What is the alignment problem?

Summary: A short description of What is the alignment problem? by Jan Leike.
Topics: AI alignment, capabilities, the hard problem of alignment
Date: March, 2023
[slides]

GPT-4

Summary: A description of the GPT-4 technical report by OpenAI.
Topics: GPT-4, Large Language Model, Capabilities, Risks
Date: March, 2023
[slides]

Self-supervised Vision

Summary: A lecture covering the basics of self-supervision in Computer Vision.
Topics: Self-supervised learning
Date: November, 2023
[slides]

research

Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff and Thomas Wang and Lintang Sutawika and Adam Roberts and Stella Biderman and Teven Le Scao and M Saiful Bari and Sheng Shen and Zheng-Xin Yong and Hailey Schoelkopf and Xiangru Tang and Dragomir Radev and Alham Fikri Aji and Khalid Almubarak and Samuel Albanie and Zaid Alyafeai and Albert Webson and Edward Raff and Colin Raffel
arXiv preprint arXiv:2211.01786
, 2022
paper, code, video_summary

Moment Detection in Long Tutorial Videos

Ioana Croitoru and Simion-Vlad Bogolin and Samuel Albanie and Yang Liu and Zhaowen Wang and Seunghyun Yoon and Hailin Jin and Trung Bui
IEEE/CVF International Conference on Computer Vision (ICCV)
, 2023
paper, code

On scalable oversight with weak LLMs judging strong LLMs

Zachary Kenton and Noah Y Siegel and János Kramár and Jonah Brown-Cohen and Samuel Albanie and Jannis Bulian and Rishabh Agarwal and David Lindner and Yunhao Tang and Noah D Goodman and Rohin Shah
Advances in Neural Information Processing Systems (NeurIPS)
, 2024
paper, coverage
Featured in quanta magazine.

teaching

Computer Vision

2021

Summary: A course on image structure and deep learning.
Module: 4F12 (Michaelmas 2021).

Computer Vision

2023

Summary: A short course on Transformers and Self-supervised learning.
Module: 4F12 (Michaelmas 2023).