Lower the Cost of Building and Running Visual AI Agents with NVIDIA VSS Blueprint 3.3
Source
Elizabeth Goodman
Author
Elizabeth Goodman
Date
Key takeaways · AI-distilled
NVIDIA says the Build Vision agent skillA reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.Full definition → starts from the closest of four tested profiles (base captioning and Q&A, alerts, long video summarization, search) and adds only the service delta, so two workflows needing a detector or Kafka share one instance.
The Build Vision Agent skill writes a self-contained build under _builds/<name>/ (override.env, compose.yml and a flattened resolved.yml), never edits the repo's deploy/docker tree, and shows an architecture diagram for review before deploying anything.
Adaptive EVS compares each patch with the prior frame by cosine similarity and drops unchanged ones; clips keeping about 70% of tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → are batched as events, those under about 30% dropped or flushed. Fixed-rate EVS already ships in vLLM and Cosmos NIM.
On an RTX PRO 6000 Blackwell with Cosmos 3 Super FP8, NVIDIA reports alert contextualization latency fell from 1,021 ms to 844 ms and concurrent real-time VLM streams rose from 13 to 19, with results varying by scene motion, chunk length and threshold.
NVIDIA says Adaptive EVS helps most when a VLM reads many frames and writes short answers, helps less for long outputs from few frames, only runs inside the RT-VLM container rather than against remote endpoints, and is optional, enabled in override.env.
Terms in this piece · Glossary
agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
Adaptive frame pruning lowers VLM cost per stream, and a prompt-driven skill assembles a search and alerting deployment on a two-GPU host in under 30 minutes, making video agents cheaper to build and run.
