Framework and Benchmark for Code-Driven Agentic Testing in Web Development
Source
Bin Hong, Zhenchao Zhang, Jiyuan He, Kai Zhang, Zhenya Huang
Author
Bin Hong, Zhenchao Zhang, Jiyuan He, Kai Zhang, Zhenya Huang
Date
Terms in this piece · Glossary
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
Why it matters
AI-generated web apps ship faster than anyone tests them, and this benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → shows current vision-language models miss subtle defects. A reality check before trusting an AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → to QA a frontend unattended.
articleGeneration of Web Apps with Agentic IDEs: An Empirical AssessmentManuel Marceca, Maria Teresa Rossi, Leonardo Mariani
articleHxAgent: Iterative Agent Planning for End-to-End Web Application TestingTu Nguyen, Duy Cao, Viet Nguyen, Phu Nguyen, Vy Le, Nguyen TK Nguyen, Tien N. Nguyen, Vu Nguyen
articleGrounding AI Agents in Contracts: An Empirical Evaluation of Spec-Driven Test GenerationMichele Tufano, James McClure, Jos\'e Cambronero, Runxiang Cheng, Sherry Y. Shi, Renyao Wei, Dorothy Chen, Franjo Ivan\v{c}i\'c, Livio Dalloro, Pat Rondon