オープンエンドな探索を意思決定支援へ:推薦の質と多様性を高める「QD-Rec」を提案
- Source
- unknown
- Author
- Sakana AI
- Date
Context
Sakana AI's QD-Rec treats recommendation as building a varied set of proposals, each pairing a candidate (a company to acquire, a customer to target, a paper to read) with a written hypothesis explaining why it is worth choosing. It borrows from quality-diversity search, which looks for many good solutions that differ from one another rather than a single best one. In each cycle a contextual bandit picks the next candidate, balancing promising ones against unexplored ones; a proposer writes a hypothesis for it by adapting an earlier hypothesis from the archive or combining several; and an evaluator scores it. A new entry with a novel angle gets its own niche, while one resembling an existing entry only has to beat its nearest neighbour, so different rationales coexist instead of all competing for first place. The method is described in an arXiv paper and a technical article.
Reusing earlier hypotheses is the point. In one example, a rejected idea that JPMorgan buy Southwest Airlines, scored 1 out of 10, contributed the idea of building lending, payments and rewards into travel purchases; moved to Liberty TripAdvisor, it scored 5, where a hypothesis written from scratch for the same company scored 1. Across M&A over about 6,300 US companies, customer targeting over 10,000 fictional profiles, and paper recommendation over about 17,500 conference papers, with claude-sonnet-5 and claude-haiku-4-5 as proposers and gpt-5.6-terra as evaluator, the authors report that QD-Rec achieved the highest mean quality in most settings and usually built the largest archive within 1,000 evaluations, compared with baselines that write every hypothesis from scratch or pick candidates at random.
Those quality numbers are LLM-judge scores, and the same scores that steer the search are used to report quality, which leaves room for proposals that exploit the judge rather than improve; the authors name this reward-hacking risk and suggest human experts take on or share the grading in real use. The examples also contain claims the model added beyond its input, and the company data date from August 2024, so the acquisition cases are outputs, not advice.
- QD-Rec treats a recommendation as a candidate paired with a written hypothesis for why to pick it, then uses a bandit to balance promising candidates against unexplored ones when choosing what to generate next.
- New hypotheses come from an LLM mutating or crossing over archived parents. A hypothesis with a new angle earns its own niche outright; otherwise it only competes one-on-one with its most similar archived entry, so diverse angles can coexist.
- Sakana tested it on about 6,300 US companies (M&A), 10,000 fictional customer profiles and about 17,500 AI conference papers; after 1,000 generate-and-score rounds, QD-Rec built larger, higher-scoring archives than a from-scratch baseline in many settings.
- Low-scoring parents can still help: a 1/10 idea for JPMorgan buying Southwest Airlines was transplanted onto Liberty TripAdvisor and scored 5/10, keeping the payments-in-travel logic while dropping airline operating and regulatory risk.
- The authors caution that generated rationales can contain facts not in the input, and that LLM graders can be gamed without real quality gains, so they suggest human experts or mixed human-LLM scoring for practical use.
- LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
- eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Checking sign-in…
Loading comments…


