The paper Exploiting Precision and Recall to assess the quality and diversity of LLMs, by Florian Le Bronnec, Alexandre Vérine, Benjamin Negrevergne, Yann Chevaleyre and Alexandre Allauzen has been accepted to the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024)!
This paper adapts the precision and recall metrics used in image generation to the context of text generation, with experiments on large language models (LLMs) such as LLAMA-2 and Mistral. Congrats to all, and especially to Florian Le Bronnec and Alexandre Vérine for leading the effort!