Unlocking the potential of vision language models on satellite imagery through fine-tuning
Source
mistral.ai
Date
Terms in this piece · Glossary
LoRA — A cheap way to fine-tune a model by training a small add-on layer instead of changing all of the model's weights.
fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
Why it matters
A concrete account of when LoRAA cheap way to fine-tune a model by training a small add-on layer instead of changing all of the model's weights.Full definition →fine-tuningTaking a trained model and training it a bit more on your own examples so it gets better at one specific job.Full definition → beats prompt engineering for vision-language models: a handful of curated domain examples steers behavior more reliably than long, fragile prompts, with measured gains over base Pixtral-12B.
