├── .gitignore ├── LICENSE ├── README.md ├── data ├── covtype.data ├── covtype_induced_drift_forward_norm.pkl ├── covtype_nodrift_norm.pkl └── electricity-normalized.csv ├── notebooks ├── Covertype_EDA.ipynb ├── Covtype_experiment_dev.ipynb └── archive │ ├── Covertype_EDA-fix.ipynb │ ├── Covtype_experiment_dev-ARR.ipynb │ ├── Covtype_experiment_dev-NM.ipynb │ ├── Electricity_EDA.ipynb │ ├── Statistical Tests Dev.ipynb │ ├── Test_Harness_Dev.ipynb │ ├── changing-distributions.ipynb │ ├── margin-density-drift-detection.ipynb │ └── plots.py ├── requirements.txt └── test_harness ├── datasets ├── __init__.py └── dataset.py ├── experiments ├── __init__.py ├── base_experiment.py ├── baseline_experiment.py ├── margin_threshold_experiment.py ├── margin_uncertainty_experiment.py ├── response_uncertainty_experiment.py └── topline_experiment.py └── utils └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/README.md -------------------------------------------------------------------------------- /data/covtype.data: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/data/covtype.data -------------------------------------------------------------------------------- /data/covtype_induced_drift_forward_norm.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/data/covtype_induced_drift_forward_norm.pkl -------------------------------------------------------------------------------- /data/covtype_nodrift_norm.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/data/covtype_nodrift_norm.pkl -------------------------------------------------------------------------------- /data/electricity-normalized.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/data/electricity-normalized.csv -------------------------------------------------------------------------------- /notebooks/Covertype_EDA.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/Covertype_EDA.ipynb -------------------------------------------------------------------------------- /notebooks/Covtype_experiment_dev.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/Covtype_experiment_dev.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Covertype_EDA-fix.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Covertype_EDA-fix.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Covtype_experiment_dev-ARR.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Covtype_experiment_dev-ARR.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Covtype_experiment_dev-NM.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Covtype_experiment_dev-NM.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Electricity_EDA.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Electricity_EDA.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Statistical Tests Dev.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Statistical Tests Dev.ipynb -------------------------------------------------------------------------------- /notebooks/archive/Test_Harness_Dev.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/Test_Harness_Dev.ipynb -------------------------------------------------------------------------------- /notebooks/archive/changing-distributions.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/changing-distributions.ipynb -------------------------------------------------------------------------------- /notebooks/archive/margin-density-drift-detection.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/margin-density-drift-detection.ipynb -------------------------------------------------------------------------------- /notebooks/archive/plots.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/notebooks/archive/plots.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/requirements.txt -------------------------------------------------------------------------------- /test_harness/datasets/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /test_harness/datasets/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/datasets/dataset.py -------------------------------------------------------------------------------- /test_harness/experiments/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /test_harness/experiments/base_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/base_experiment.py -------------------------------------------------------------------------------- /test_harness/experiments/baseline_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/baseline_experiment.py -------------------------------------------------------------------------------- /test_harness/experiments/margin_threshold_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/margin_threshold_experiment.py -------------------------------------------------------------------------------- /test_harness/experiments/margin_uncertainty_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/margin_uncertainty_experiment.py -------------------------------------------------------------------------------- /test_harness/experiments/response_uncertainty_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/response_uncertainty_experiment.py -------------------------------------------------------------------------------- /test_harness/experiments/topline_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/experiments/topline_experiment.py -------------------------------------------------------------------------------- /test_harness/utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fastforwardlabs/concept-drift/HEAD/test_harness/utils/utils.py --------------------------------------------------------------------------------