Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Samuel Albanie

Posts

digests

Big O notation: Samuel’s guide

Summary: Samuel's tutorial on big O notation and other asymptotic notation (little o, big theta, big omega, little omega).
Topics: Complexity, data structures, algorithms, analysis
Date: October, 2022
[slides]

ReCo: Retrieve and Co-segment for Zero-Shot Transfer

Summary: A short description of the ReCo framework introduced in the work 'ReCo: Retrieve and Co-segment for Zero-shot Transfer' by G. Shin, W. Xie and S. Albanie, published at NeurIPS in 2022.
Topics: semantic segmentation, foundation models, zero shot transfer
Date: October, 2022
[slides]

Scaling Instruction-Finetuned Language Models (Flan-PaLM)

Summary: A description of the the work 'Scaling Instruction-Finetuned Language Models' by Hyung Won Chung et al. published on arxiv in October 2022. This work introduced the Flan-PaLM 540B model.
Topics: instruction finetuning, foundation models, large language models
Date: October, 2022
[slides]

Crosslingual Generalization through Multitask Finetuning (BLOOMZ & mT0)

Summary: A description of the the work 'Crosslingual Generalization through Multitask Finetuning' by Niklas Muennighoff et al. published on arxiv in November 2022 as part of the BigScience Workshop. This work introduced the BLOOMZ and mT0 models.
Topics: multitask finetuning, foundation models, large language models, multilingual models
Date: November, 2022
[slides]

B-trees: Samuel’s guide

Summary: Samuel's tutorial on the B-tree data structure.
Topics: B-trees, data structures, algorithms, coding
Date: December, 2022
[slides]

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Summary: A description of the the work 'BLOOM: A 176B-Parameter Open-Access Multilingual Language Model' by Le Scao et al. published on arxiv in November 2022 as part of the BigScience Workshop. This work provides an overview of the BLOOM model and the efforts involved in its creation.
Topics: foundation models, large language models, multilingual models
Date: January, 2023
[slides]

research

Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff and Thomas Wang and Lintang Sutawika and Adam Roberts and Stella Biderman and Teven Le Scao and M Saiful Bari and Sheng Shen and Zheng-Xin Yong and Hailey Schoelkopf and Xiangru Tang and Dragomir Radev and Alham Fikri Aji and Khalid Almubarak and Samuel Albanie and Zaid Alyafeai and Albert Webson and Edward Raff and Colin Raffel
arXiv preprint arXiv:2211.01786
, 2022
paper, code, video_summary

teaching