A Good CREPE Needs More Than Just Sugar: Investigating Biases in Compositional Vision-Language Benchmarks

Vishaal Udandarao and Mehdi Cherti and Shyamgopal Karthik and Jenia Jitsev and Samuel Albanie and Matthias Bethge, arXiv preprint arXiv:2506.08227, 2025
paper

@article{Udandarao2025crepe,
    author = "Udandarao, Vishaal and Cherti, Mehdi and Karthik, Shyamgopal and Jitsev, Jenia and Albanie, Samuel and Bethge, Matthias",
    title = "A Good CREPE Needs More Than Just Sugar: Investigating Biases in Compositional Vision-Language Benchmarks",
    year = "2025",
    month = "June",
    journal = "arXiv preprint arXiv:2506.08227"
}