Elie Bakouch works on language-model training and autonomous AI research at Prime Intellect, after contributing to the SmolLM series at Hugging Face. His published work spans distributed pretraining, agent evaluation and persistent research-agent environments.[2][5][3]
Start with Measuring Autonomous AI Research →Links
Hugging Face LinkedInPretraining and mid-training research · Prime Intellect
Career
Bakouch announced his move to Prime Intellect to work on pretraining and mid-training, reflecting on the SmolLM models his team had developed at Hugging Face. He is also a co-author of the INTELLECT-1 report, which describes training a ten-billion-parameter model across geographically distributed contributors. The report’s infrastructure handles changing groups of available devices and recovery from interrupted workers. It explores how training can continue when participants and network conditions are less predictable than in a single managed cluster.[2][4]
Contributions
Measuring research rather than assuming it
In a Prime Intellect study, Bakouch and collaborators ran 153 autonomous research attempts across 18 frontier models on a nanoGPT optimizer speedrun. Agents received a training baseline and sought improvements without internet access. The team compared repeated runs and released traces and experiment records. Results varied substantially between models and seeds. The study found useful improvements but no fundamentally new method among the runs, making it a test of experimentation and execution as well as idea generation. Its narrow setting does not establish general autonomous scientific ability.[3]
An environment that preserves the work
Bakouch co-authored the Prime Agent technical report. Its harness gives an agent a persistent IPython environment for processing context and running computations, while preserving histories, memories and reusable instructions across attempts. Subagents can communicate directly, and a human-facing view exposes ongoing sessions. The design separates execution, recovery and resource accounting from the strategy the model chooses. This makes failures of the surrounding software less likely to obscure what the model itself can accomplish.[5]
Tools, writing & talks
Writing, research & talks
Start here
Measuring Autonomous AI Researchprimeintellect.aiAn open experiment comparing agent research attempts, with traces and explicit limits on novelty.
Start with the autonomous-research study’s setup and limitations before comparing its traces. Basic familiarity with training loss is helpful; the paper on Prime Agent explains the surrounding machinery.
Prime Intellect research contributor and article author.[3]Prime Intellect set Claude Code and Codex loose on the community's GPT-2 speedrun record: both beat it, but behaved very differently (Codex ran nonstop, Claude Code idled a third of the time). Neither model invented a new optimizer, just recombined known ideas.
Catalog workOriginal source- ⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDFyoutube.com
A Hugging Face researcher walks through SmolLM3 training choices and the FineWeb and FinePDF datasets, explaining open pretraining practice for small language models.
Catalog workOriginal source Technical report on persistent execution, context processing and recovery for long-running agents.
Co-author.[5]- INTELLECT-1 Technical Reportarxiv.org
Report on collaborative distributed training and infrastructure for changing worker availability.
Co-author.[4]