How Web Data Infrastructure Powers the Next Generation of AI — Patricija Žemaitytė, Oxylabs
- Source
- AI Engineer
- Author
- AI Engineer
- Date
The load-testing observation, that instrumentation at high request volume distorts the measurement it is taking, is a failure mode teams hit when scaling any high-throughput data pipeline for AI.
“Patricija Žemaitytė treats that as the useful distinction: something that works in development, something that passes tests, and something that survives reality are three different systems.”
“It averages 550 milliseconds now, against a 4 second baseline.”
“The punchline she offers is that the client has since collected 30 petabytes and has not paid yet.”
“Scaling the unblocker from 10,000 to 60,000 requests per second hit a wall around 20,000 in load testing, where the real difficulty was not generating synthetic traffic but knowing whether the number meant anything, since telemetry at that volume becomes part of the load it measures.”
“Her argument throughout is that this is not a build once business, it is an adapt forever one.”
videoThe Missing Layer in Agentic AI — Giedrius Šteimantas, OxylabsAI Engineer
videoVertical Mobility: Inference from MVP to Trillion-Parameter Workloads — Sitanshu Gupta, CoreWeaveAI Engineer
videoServing 2 Million Models Without Melting: Scaling the Hugging Face Hub — Arek Borucki, Hugging FaceAI Engineer
Checking sign-in…
Loading comments…



