OSS Python library for detecting silent ML model failure
NannyML estimates real-world model performance (without access to targets) and alerts you when and why it changed. The performance estimation algorithm, confidence-based performance estimation (CBPE), was researched by core contributors.