Vibeleaderboard
Index / tool
Visit github.com
Category
AI Agents
Rank
No. 3570Tools index

Previous survey · No. 3393 ·

Pricing
Open Source
Type
TOOL
Use case
Agent Building · Model & Agent Evaluation
GitHub
112 stars
Latest release
v1.0.0
Date

About

Proteus is a framework that plugs into an agent harness and lets it rewrite its own prompts, memory, skills, tools and control loop over many context-fresh episodes. It then measures how the harness changes, under a single goal, many goals, or none.

At a glance

Proteus runs experiments that modify an agent’s prompts, memory, skills or harness and measure what happens. It is worth evaluating if you want to compare improvement methods while keeping the task and evaluation rules fixed.

Good fit

Researchers and developers who can define a repeatable task, a baseline and held-out tests.

Consider something else when

Start with a single evaluation script if you only need to compare two static prompts once.

Start here

Choose one small recipe and keep the agent and evaluator fixed. Compare the baseline with a candidate on cases that were withheld from the optimization loop.

Cost and requirements

MIT-licensed. The manifest requires Python 3.10 or later. Model access, harnesses and optional execution infrastructure depend on the recipe.

Limits to know

A candidate can improve against visible feedback without generalizing. Keep held-out scores out of the optimization loop and track the additional calls and execution cost.

Intel on Proteus

More in Intel

Tags

ai-agentsself-evolutionharnessevaluationpythonresearch

Tech Stack

Python

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.