Gittins

About

Gittins is a contextual bandit engine that learns online one observation at a time with constant work per update. It handles drifting data, changing action sets and late or missing rewards, supports offline policy evaluation, and lets users supply their own models and exploration algorithms. It is available for Python, npm and the browser, and models can run in memory, from a flat file or as a shared service.