A free model API can be suitable for repeated experiments yet too constrained for an application's traffic. OpenRouter'scomparison distinguishes recurring free allowances from trial credits that eventually run out. Request limits introduce another constraint: a service can cap both short bursts and total daily use. Its rate-limit documentation also distinguishes OpenRouter's own limits from shortages at an underlying provider. Switching providers can address the latter; it does not remove the platform's quota. A useful comparison therefore matches the allowance and request ceilings to the workload.
Terms in this piece · Glossary
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
