We ran Thinking Machines Inkling through our private coding-agent bench. Same ha
Source
AlphaSignalAI
Author
AlphaSignalAI
Date
Why it matters
Independent benchmark data on Thinking Machines' Inkling across a 13-bug repair harness — a reality check on frontier coding-agent claims.
Same harness as the rest of the field.
Signaldesk v1: 13 planted bugs in a ~7k-line full-stack app, network-off Docker sandboxes, hidden tests at score time.
Across 8 models and 553 attempts, Inkling https://t.co/6k7O4VrQJm https://t.co/Pb7812GT3j
Transcript
We ran Thinking Machines Inkling through our private coding-agent bench.
Same harness as the rest of the field. Signaldesk v1: 13 planted bugs in a ~7k-line full-stack app, network-off Docker sandboxes, hidden tests at score time.
Across 8 models and 553 attempts, Inkling https://t.co/6k7O4VrQJm https://t.co/Pb7812GT3j
