Generative Ai For High Quality Mobile Testing
- Source
- uber.com
- Author
- Uber Engineering 1
- Date
Uber built DragonCrawl to solve a problem familiar to any team running mobile end-to-end tests: script-based testers break every time a UI changes, and keeping them working had eaten 30-40% of engineers' time. DragonCrawl replaces brittle selectors with an LLM that looks at a screen the way a person would and decides what to tap next, so a redesigned button or a shuffled menu doesn't require someone to go rewrite a test script. The approach scales across more than 50 languages without separate localized test suites, since the model is reading the screen rather than matching hardcoded strings. It's a useful data point for anyone weighing whether to bring LLM-driven testing into a large, multilingual mobile codebase: Uber is reporting this in production, not as a research prototype, and framing the win specifically in engineer-hours reclaimed rather than abstract accuracy numbers. That's the kind of ROI case that tends to travel well internally when a team is deciding whether to invest in agentic test tooling.
Context
DragonCrawl runs mobile tests by choosing actions from the current screen and a stated goal. Uber Engineering supplies a text representation of the screen to a , allowing it to adjust when buttons or intermediate screens change. The system checks proposed actions against information from the emulator and retries or backtracks when suggestions are invalid.
Uber reports that DragonCrawl requested and completed trips in 85 of 89 evaluated cities without needing code tweaks. Uber contrasts this with scripted tests, which it says need recurring maintenance when pop-ups or buttons change. The result covers the trip-request flow that the account describes, not mobile testing in general.
- LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
articleDragonCrawl: A Generative, Intent-Based Framework for Scalable Mobile End-to-End TestingSowjanya Puligadda, Mengdie Zhang, Ali Zamani, Dhruva Dixith Kurra, Eric Chen, Juan Marcano- articleQa Agent Reimagining Software Quality With Ai Driven Autonomous TestingLinkedIn Engineering
articleScaling Ai Ml Infrastructure At UberUber Engineering 1
Checking sign-in…
Loading comments…