Designing an assistant's behavior requires decisions about uncertainty and competing values. In Anthropic'sphilosophy interview, Amanda Askell describes the work on Claude's character as translating ethical ideas into judgments about how the model should behave in actual situations.
Askell explains that applying a theory to a real decision forces consideration of context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → and other reasonable views. The stated aspiration is for models to show ethical nuance under difficult conditions, and Askell says it is unclear whether current models make superhuman moral decisions. The account makes character design an ongoing exercise in practical judgment.
Terms in this piece · Glossary
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.