LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
Why it matters
It shows how to fold recommendation capability directly into an LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → via semantic item IDs, eliminating separate retrieval/tool infrastructure — useful for anyone building steerable, conversational recommender systems.
Key quotes
“The idea is simple: Instead of using random hash IDs for videos or songs or products, we can use semantically meaningful tokens that an LLM can natively understand.”
Eugene Yan
“The result is a language model that can converse in both English and item IDs, not with retrieval or other tools, but as a single, “bilingual” model where items (i.e., semantic IDs) are part of its vocabulary.”
Eugene Yan
“While this LLM-recommender hybrid may not match the raw precision of a specialized multi-stage recsys, it offers a new capability: steerability and reasoning on recommendations”
Eugene Yan
“In my experiments with a three-level codebook, with each level having 256 codes, we saw collisions on ~10% of the 66k products.”
Eugene Yan
“The trained RQ-VAE achieved 89% unique semantic IDs across 66k products on the three quantization levels.”
