Using simulation to bake off open-source models in the agent harness

keep our SSR rates and TPS rates very very high. This is one example that I am most excited about. As you know, all of you know open source models have been on a tear recently. So many of them have come out. So, we've been trying to test various open source models in our agent harnesses and see which ones are the best. And with SIM, we have the perfect recipe to just throw a bunch of ideas, open source models at our agent harness and eval setup and see which model versions uh you know really really work for us. Uh this has saved us multiple weeks of effort and probably underelling it. It's it's been it's been pretty awesome and uh we have AB test running as I speak uh figuring out are these open source models as good as you know uh the frontier models. So SIM is is is been super super helpful in helping us figure out uh kind of you know spreading our cards uh a bit.