Sierra Research
1 Tool · 2 Intel
Sierra Research is the GitHub organization for Sierra, an AI platform company that builds conversational AI agents for customer experience. Sierra was co-founded in 2023 by Bret Taylor, former Co-CEO of Salesforce and CTO of Facebook, and Clay Bavor, a former Google VP who led Google Labs, Project Starline, and Google Lens. The company, based in San Francisco with offices worldwide, deploys branded AI agents for customer service and operations for enterprises including SiriusXM, Sonos, ADT, and Rocket Mortgage. Its GitHub presence hosts open benchmarking research on tool-using AI agents.
Tools
Benchmark where agent, user, policy, and a shifting environment must stay aligned through a whole task.
Intel
τ-bench 2.0.0 adds multilingual packs (en, es, pt, hi, zh, ko), frozen voice and text benchmarks, an entity-capture intake domain, and post-hoc judges. Scores differ from 1.x, so results must be re-run.
A τ-bench 1.0.1 release fixing banking_knowledge grading, where a systematic penalty had zeroed rewards for correct-but-cautious agent behaviour. Re-grading moves scores only upward, so results are not comparable across the release.