Clip / AI Tools

Same open-source robot, two boards: interaction quality tracks compute

From Why Large? Tiny LMs & Agents on Edge/Robotics — Cormac Brick, Google · ≈10:18

A side-by-side hobby build shows that for voice+vision robots the difference between usable and unusable is the board, not the model — today's best small models still miss some interaction budgets.

What’s in it

A side-by-side hobby build shows that for voice+vision robots the difference between usable and unusable is the board, not the model — today's best small models still miss some interaction budgets.

Watch this moment

Clip transcript

models if this is what you want to do. Okay, this is another example uh which I'm not going to play this video but you should definitely check it out. This is an example showing a um an open- source the open doc mini v2 robot. This is one um Zavier, one of the um engineers in deep mind built this as a kind of hobby project. Really really fun. Um so go check out this YouTube video. What you what you'll see is he has two robots. One is uh one uses the Jets and Nano, one uses the Raspberry Pi. And um you'll see that the robot is able to um it's it's able to kind of like read signs like um and react to things and kind of nod its head. It's also kind of able to take both voice and image input. Um yeah, and what you'll see is the Jets Nano one performs uh has really good real-time interaction. the one based on Raspberry Pi it works but it's kind of a lot slower right so for some examples um for some types of interaction um even the kind of best models we have today are are maybe not meeting a kind of user interaction requirements