Code Health in LLM-Based Test Generation: Effectiveness and Token Efficiency
Source
arxiv.org
Author
Freya Wirdemann, Markus Borg, Nadim Hagatulah, Adam Tornhill
Date
Why it matters
Predicts where LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → test generation pays off and what it costs in tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition →, before you spend them.
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
articleHow effective are traditional test criteria at detecting bugs in large language models generated code?Asma Hamidi, Michael Konstantinou, Renzo Degiovanni, Mike Papadakis
articleVibeCheck: Assessing the Quality of LLM-Generated Unit Tests: A Multi-agent Empirical Study across Heterogeneous RepositoriesAnika Tabassum, Mushahid Intesum, Md. Fahim Arefin, Tarannum Shaila Zaman
articleAn Empirical Evaluation of Cost-Efficient Large Language Models on Algorithmic Programming TasksChandimal Adikari, Nandika Herath