Vibeleaderboard
← Benchmark guide

Model results

FrontierCode

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Evaluation groups

Open a group to see its exact protocol and scores. Different configurations remain separate.

No model rankings are available in this snapshot. Reported results remain available below.

Other reported results

These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.

  • Claude Opus 5.51.1-main

    FrontierCode v1.1 (Main) · Anthropic (reviewed publisher results)

    Single-model result · Positions withheld

    Measurement date 2026-09-22

    Scope · Vendor-reported in Anthropic's Claude Opus 5.5 launch table; adaptive thinking at max effort unless …

    Vendor-reported in Anthropic's Claude Opus 5.5 launch table; adaptive thinking at max effort unless noted; evaluated with production safeguards on, and where they intervened, cybersecurity tasks fell back to Claude Opus 4.8 and biology/frontier-LLM tasks to Claude Opus 5 (Anthropic says this likely lowers scores); Main split; dated to the announcement

  • Claude Sonnet 5.5Version not reported

    FrontierCode · Cognition via Epoch AI

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Harness claude-code · Aggregation Mean@5 · effort xhigh · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness chisel · Aggregation Mean@5 · effort high · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness chisel · Aggregation Mean@5 · effort max · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness chisel · Aggregation Mean@5 · effort medium · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    3 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness chisel · Aggregation Mean@5 · effort unspecified · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness claude-code · Aggregation Mean@5 · effort max · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness claude-code · Aggregation Mean@5 · effort medium · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    6 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness claude-code · Aggregation Mean@5 · effort unspecified · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    3 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness codex · Aggregation Mean@5 · effort max · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    5 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness codex · Aggregation Mean@5 · effort unspecified · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    3 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness grok-build · Aggregation Mean@5 · effort unspecified · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    2 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness mini-swe-agent · Aggregation Mean@5 · no reasoning · result date not supplied

  • FrontierCodeVersion not reported

    Cognition via Epoch AI

    4 models with scores · Positions withheld

    Measurement date not reported

    Scope · Harness mini-swe-agent · Aggregation Mean@5 · result date not supplied

  • GPT-6.1 SolVersion not reported

    FrontierCode · Cognition via Epoch AI

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Harness codex · Aggregation Mean@5 · effort medium · result date not supplied

  • Kimi K3Version not reported

    FrontierCode · Cognition via Epoch AI

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Harness mini-swe-agent · Aggregation Mean@5 · effort unspecified · result date not supplied

  • Nemotron 3 UltraVersion not reported

    FrontierCode · Cognition via Epoch AI

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Harness chisel · Aggregation Mean@5 · result date not supplied

FrontierCode model results | VibeLeaderboard