Vibeleaderboard
← All Intel
Intel / video

Steering LLM Behavior Without Fine-Tuning

Source
youtube.com
Author
Hugging Face
Date

Context

A 's behavior can be changed while it generates an answer, without retraining its stored parameters. This tutorial explains : adding a chosen pattern of numbers to the model's intermediate calculations. The pattern is associated with a concept, and a multiplier controls the strength of the intervention. In the narrated example, using a Llama 3.1 8B model, an Eiffel Tower pattern makes the model's answers increasingly revolve around that subject. Watch the explanation.

The intervention amplifies something the model already represents; it does not teach new knowledge. Push it too strongly and the output becomes incoherent. Steering therefore offers an adjustable way to influence behavior, with a tradeoff between the desired influence and fluent answers. See the tutorial's limitations.

Terms in this piece · Glossary
  • LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
  • activation steering — Changing a model's behavior by nudging its internal activations directly at runtime — no retraining, no prompt changes.
  • inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
  • fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
Read the source www.youtube.com
More from Hugging Face
Recommended reads
Comments

Checking sign-in…

Loading comments…