LexFrame

About

LexFrame is a Python toolkit for interpreting language model hidden states. It passes a hidden state through the model's own remaining layers, lets it attend to its prefix, and reads the result in the model's vocabulary. This lets users read, attribute and steer predictions at every layer, including middle layers where fixed-frame lenses such as the logit lens often miss what the model already knows.