Checking for modeling pitfalls and remediation#

Examples for each automated check. Each script reproduces a check, and walks through fixes described in Automated checks.

SKD001 & SKD002 - Overfitting and underfitting

SKD001 & SKD002 - Overfitting and underfitting

SKD004 - High class imbalance

SKD004 - High class imbalance

SKD007 - MDI feature importance is biased for high-cardinality features

SKD007 - MDI feature importance is biased for high-cardinality features

SKD008 - Highly correlated input features

SKD008 - Highly correlated input features

SKD013 - Train-test overlap in time series

SKD013 - Train-test overlap in time series

SKD014 & SKD015: Hyperparameter search pitfalls

SKD014 & SKD015: Hyperparameter search pitfalls

SKD016 - Estimator not tuned

SKD016 - Estimator not tuned