illate-parity

About

A Python command-line tool that checks whether a cheaper model performs as well as the one currently in use. It scores each model from prediction files with bootstrap confidence intervals, then runs a non-inferiority test to see whether the candidate stays within an agreed margin of the current model at 95% confidence. It needs no GPU or API keys and depends only on NumPy.