How Long Is a Piece of String? A Brief Empirical Analysis of Tokenizers

Jonathan Roberts and Kai Han and Samuel Albanie, ICML Workshop on Combining Theory and Benchmarks (CTB), 2026
paper

@inproceedings{Roberts2026tokenizers,
    author = "Roberts, Jonathan and Han, Kai and Albanie, Samuel",
    title = "How Long Is a Piece of String? A Brief Empirical Analysis of Tokenizers",
    year = "2026",
    month = "July",
    booktitle = "ICML Workshop on Combining Theory and Benchmarks (CTB)"
}