Vibeleaderboard
← All Intel
Intel / post

Cua Ships Python and TypeScript SDKs for In-Process Computer Use

Source
x.com
Date
Cua@trycua
Thread · 4 parts

1/ New SDKs for background computer use. Use Cua Driver from Python or TypeScript, directly inside your app. Get started: https://t.co/7XtTP4biy0

2/ Your app owns the runtime. CuaDriver.create() loads the Rust engine in the importing process. Python and TypeScript share the same typed contract. Keep one driver object alive across calls, from creation to shutdown.

3/ Click a button without bringing its window forward. Call getWindowState(), select its element token, then click() with InputDeliveryMode.Background. Background support varies by app and OS. Read fresh state to verify the effect.

4/ Install cua-driver for Python or @trycua/cua-driver for TypeScript. Your app owns desktop permissions and cleanup. Use a private worker when you need process isolation. Python and TypeScript examples: https://t.co/7XtTP4biy0

Context

Cua released Python and TypeScript SDKs that let an application use Cua Driver, its desktop-automation engine, from inside the app's own process. Per Cua, CuaDriver.create() loads the Rust engine in the importing process, so the app owns the runtime. Both languages share the same typed contract, and Cua advises keeping one driver object alive from creation to shutdown.

The SDKs support background clicking: call getWindowState(), select an element from it, then click() with the background input mode, which clicks a button without bringing its window forward. Cua warns that background support varies by app and OS and says to read fresh state to verify the effect. The app also owns desktop permissions and cleanup, and Cua suggests a private worker when process isolation is needed.

Terms in this piece · Glossary
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
More from Cua
Recommended reads
Comments

Checking sign-in…

Loading comments…