transformer — The neural network architecture behind modern AI models, built on attention — letting every word directly consider every other word in parallel.
attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
pretraining — The first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.
Why it matters
Krea 2 ships as open-weights foundation image models (K2 Raw and K2 Turbo) built for controllable style rather than a single default aesthetic, giving builders a locally-runnable, permissively licensed alternative to closed image APIs.