Understanding that GPT defaults to code/math, Llama to narratives, DeepSeek to religious content, and Qwen to exam questions helps engineers anticipate model biases when prompts are underspecified—useful for prompt design, model selection, and eval construction.
What do language models generate when you don't tell them what to generate?
New research reveals that LLM families have distinct 'knowledge priors'—GPT models default to code and math, Llama favors narratives, DeepSeek generates religious content, and Qwen outputs exam questions.
Transcript
What do language models generate when you don't tell them what to generate? New research reveals that LLM families have distinct 'knowledge priors'—GPT models default to code and math, Llama favors narratives, DeepSeek generates religious content, and Qwen outputs exam questions.
