├── .gitignore ├── DECEandECEcorrelations.png ├── Data ├── .gitignore ├── __init__.py ├── cifar10.py └── cifar100.py ├── Experiments ├── .gitignore ├── __init__.py └── rn18_c10_meta_calibration.json ├── LICENSE ├── Losses ├── .gitignore ├── __init__.py ├── brier_score.py ├── dece.py ├── focal_loss.py ├── focal_loss_adaptive_gamma.py ├── loss.py └── mmce.py ├── Metrics ├── .gitignore ├── __init__.py ├── metrics.py ├── ood_test_utils.py └── plots.py ├── Models └── __init__.py ├── Net ├── .gitignore ├── __init__.py ├── resnet.py └── wide_resnet.py ├── README.md ├── environment.yml ├── evaluate.py ├── evaluate_scripts ├── cifar10.sh └── cifar100.sh ├── temperature_scaling.py ├── train.py ├── train_scripts ├── cifar10.sh └── cifar100.sh └── train_utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/.gitignore -------------------------------------------------------------------------------- /DECEandECEcorrelations.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/DECEandECEcorrelations.png -------------------------------------------------------------------------------- /Data/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Data/.gitignore -------------------------------------------------------------------------------- /Data/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Data/cifar10.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Data/cifar10.py -------------------------------------------------------------------------------- /Data/cifar100.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Data/cifar100.py -------------------------------------------------------------------------------- /Experiments/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Experiments/.gitignore -------------------------------------------------------------------------------- /Experiments/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Experiments/rn18_c10_meta_calibration.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Experiments/rn18_c10_meta_calibration.json -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/LICENSE -------------------------------------------------------------------------------- /Losses/.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | -------------------------------------------------------------------------------- /Losses/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Losses/brier_score.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/brier_score.py -------------------------------------------------------------------------------- /Losses/dece.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/dece.py -------------------------------------------------------------------------------- /Losses/focal_loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/focal_loss.py -------------------------------------------------------------------------------- /Losses/focal_loss_adaptive_gamma.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/focal_loss_adaptive_gamma.py -------------------------------------------------------------------------------- /Losses/loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/loss.py -------------------------------------------------------------------------------- /Losses/mmce.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Losses/mmce.py -------------------------------------------------------------------------------- /Metrics/.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | -------------------------------------------------------------------------------- /Metrics/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Metrics/metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Metrics/metrics.py -------------------------------------------------------------------------------- /Metrics/ood_test_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Metrics/ood_test_utils.py -------------------------------------------------------------------------------- /Metrics/plots.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Metrics/plots.py -------------------------------------------------------------------------------- /Models/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Net/.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | -------------------------------------------------------------------------------- /Net/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Net/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Net/resnet.py -------------------------------------------------------------------------------- /Net/wide_resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/Net/wide_resnet.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/README.md -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/environment.yml -------------------------------------------------------------------------------- /evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/evaluate.py -------------------------------------------------------------------------------- /evaluate_scripts/cifar10.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/evaluate_scripts/cifar10.sh -------------------------------------------------------------------------------- /evaluate_scripts/cifar100.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/evaluate_scripts/cifar100.sh -------------------------------------------------------------------------------- /temperature_scaling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/temperature_scaling.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/train.py -------------------------------------------------------------------------------- /train_scripts/cifar10.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/train_scripts/cifar10.sh -------------------------------------------------------------------------------- /train_scripts/cifar100.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/train_scripts/cifar100.sh -------------------------------------------------------------------------------- /train_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ondrejbohdal/meta-calibration/HEAD/train_utils.py --------------------------------------------------------------------------------