Vibeleaderboard
← All Intel
Intel / video

How Web Data Infrastructure Powers the Next Generation of AI — Patricija Žemaitytė, Oxylabs

Source
AI Engineer
Author
AI Engineer
Date
Why it matters

The load-testing observation, that instrumentation at high request volume distorts the measurement it is taking, is a failure mode teams hit when scaling any high-throughput data pipeline for AI.

Key quotes

“Patricija Žemaitytė treats that as the useful distinction: something that works in development, something that passes tests, and something that survives reality are three different systems.”

“It averages 550 milliseconds now, against a 4 second baseline.”

“The punchline she offers is that the client has since collected 30 petabytes and has not paid yet.”

“Scaling the unblocker from 10,000 to 60,000 requests per second hit a wall around 20,000 in load testing, where the real difficulty was not generating synthetic traffic but knowing whether the number meant anything, since telemetry at that volume becomes part of the load it measures.”

“Her argument throughout is that this is not a build once business, it is an adapt forever one.”

Read the source www.youtube.com
More from AI Engineer
Recommended reads
Comments

Checking sign-in…

Loading comments…