Vibeleaderboard
Index / agent
Visit github.com
Category
AI Agents
Rank
No. 500Tools index
Pricing
Open Source
Platform
cli
Type
AGENT
Builder
@alxfazio
GitHub
309 stars
Added
Jul 4, 2026

About

ARCgentica is an agentic AI system that solves ARC-AGI-2 challenges by deploying LLM-powered sub-agents to analyze input-output grid examples, write Python transform programs, and evaluate them against test inputs. It achieved 85.28% on the ARC-AGI-2 public evaluation using Claude Opus 4.6, making it one of the top-performing open solutions to this benchmark. It's useful for researchers and developers studying AI reasoning, program synthesis, and abstract pattern recognition.

What it can do

  • Solve ARC-AGI grid puzzles autonomously

    ARC-AGI input-output grid examplesPredicted output grids for test inputs

  • Synthesize Python transformation programs

    Grid pattern examples showing input-output relationshipsExecutable Python code that transforms input grids to output grids

  • Analyze abstract visual patterns in grids

    ARC-AGI puzzle grid dataIdentified transformation rules and pattern descriptions

  • Evaluate generated programs against test inputs

    Python transform programs and test grid inputsEvaluated solutions with pass/fail scoring results

  • Run multi-agent reasoning pipelines

    ARC-AGI puzzle and selected LLM backend (OpenAI, Anthropic, or OpenRouter)Coordinated sub-agent analysis and solution attempts

  • Score and benchmark solution performance

    Completed puzzle run resultsAccuracy scores and performance metrics across puzzle sets

  • Generate detailed run logs for AI reasoning research

    Executed ARC-AGI solving sessionsFull logs of agent reasoning steps, program attempts, and evaluations

Why it made the leaderboard

If you're researching symbolic AI, program synthesis, or multi-agent LLM architectures, ARCgentica gives you a fully open-source, auditable implementation that achieves one of the highest publicly reported scores on ARC-AGI-2 — a benchmark specifically designed to resist LLM shortcuts. The sub-agent architecture that writes and evaluates Python transformation programs is a concrete, reusable pattern for anyone building reasoning-heavy agent systems.

Tags

arc-agillmagentic-aiprogram-synthesisbenchmarkingpythonclaudeabstract-reasoning

Tech Stack

Python

Comments (0)

No comments yet

Indexed by a proprietary survey. Corrections welcome.