embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
Why it matters
Shows what it takes to serve LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → semantic retrieval and ranking under real-time QPS budgets — including exhaustive GPU vector search instead of ANN, and where model quality was traded for latency.