The AI application skill stack: grounding, agent loops, evals, production
Source
Andrew Ng
Author
Andrew Ng
Date
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
grounding — Tying a model's answers to checkable sources — retrieved documents, live data, tool results — instead of letting it answer from memory alone.
RAG — Retrieval-augmented generation — fetching relevant documents first and pasting them into the model's context so it answers from your data instead of memory.
agentic loop — The cycle an agent runs in: decide, call a tool, read the result, decide again — repeating until the goal is met or a stop condition fires.
Why it matters
Names the trait Ng says most separates strong AI engineers — running a disciplined evals and error-analysis loop — rather than any particular framework choice.