The Vibe Shift in Software Engineering: Evaluating AI-Led Conversational Programming for Performance, Cognition, and Responsible Adoption
- Source
- arxiv.org
- Author
- Sales G. Aribe Jr., Louie Jay S. Labastida
- Date

Context
A 30-participant study reports that conversational, AI-led programming shortened task completion while producing code-quality trade-offs. Professional developers and advanced computing students completed equivalent tasks under traditional, AI-assisted and AI-led conditions. The authors report that AI-led programming took 27% less time than traditional coding and 12% less than AI-assisted coding, alongside lower maintainability scores and more security vulnerabilities.
The finding separates finishing a programming task quickly from producing code that is easy to maintain and secure. It gives a reason to evaluate those outcomes together when assessing a conversational coding workflow. The reported percentages describe this experiment, rather than an established productivity gain across software teams.
- vibe coding — Building software by describing what you want to an AI in plain language and steering the result, instead of writing every line yourself.
“Results show that vibe coding significantly improved development efficiency, reducing task completion time by 27% compared with traditional coding and 12% compared with AI-assisted coding.”
“However, these gains were accompanied by lower maintainability indices and higher security vulnerabilities, indicating trade-offs in software quality.”
“Notably, perceived loss of control was associated with increased security risks due to reduced transparency and validation of AI-generated outputs.”
“Overall, vibe coding enhances productivity but requires critical oversight, reinforcing its role as a transformative yet transitional paradigm in software development.”
articleVibe Coding: Practice, Performance, Productivity, and Risk -A State-of-the-Art ReviewDominik L. Michels, Mutaz Abu Ghazaleh, Francois Lazzari, Nabil Kassem, Jonathan Klein
articleHow Researchers Use and Verify AI Coding Assistants: Tasks and Validation Practices in Scientific ProgrammingGabrielle O'Brien, Reed Milewicz, Nasir Eisty
videoVibe coding in prod | Code w/ ClaudeAnthropic
Checking sign-in…
Loading comments…