├── .gitignore ├── LICENSE ├── README.md ├── TABLE.md ├── data-analysis ├── Example_Pascal_VOC.jpg ├── calc_rmse.py ├── data_analysis.ipynb ├── rmse_configs │ ├── coco17test.py │ └── voc07test.py ├── robustness_eval.py └── visualize_corruptions.ipynb ├── figures ├── introduction │ ├── traffic_hazards.pdf │ └── traffic_hazards.png ├── methods │ ├── stylization_figure.key │ ├── stylization_figure.pdf │ ├── stylization_figure.png │ ├── visualize_corruptions_3_cropped.pdf │ └── visualize_corruptions_3_cropped.png └── results │ ├── cityscapes_corruption_individual.pdf │ ├── cityscapes_corruption_overall.pdf │ ├── coco_corruption_backbones_individual.pdf │ ├── coco_corruption_individual.pdf │ ├── coco_corruption_overall.pdf │ ├── pascal_corruption_individual.pdf │ ├── pascal_corruption_overall.pdf │ └── rpc_vs_rmse.pdf └── raw-data ├── cityscapes ├── faster_rcnn_r50_fpn_1x_city_results.pkl ├── faster_rcnn_r50_fpn_1x_cityscity_results.pkl ├── faster_rcnn_r50_fpn_1x_scity_results.pkl ├── mask_rcnn_r50_fpn_1x_city_results.pkl ├── mask_rcnn_r50_fpn_1x_cityscity_results.pkl └── mask_rcnn_r50_fpn_1x_scity_results.pkl ├── coco ├── cascade_mask_rcnn_r50_fpn_1x_results.pkl ├── cascade_rcnn_r50_fpn_1x_results.pkl ├── coco_rmse.csv ├── faster_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl ├── faster_rcnn_dconv_c3-c5_x101_32x4d_fpn_1x_results.pkl ├── faster_rcnn_r101_fpn_1x_results.pkl ├── faster_rcnn_r50_fpn_1x_coco_results.pkl ├── faster_rcnn_r50_fpn_1x_cocoscoco_results.pkl ├── faster_rcnn_r50_fpn_1x_results.pkl ├── faster_rcnn_r50_fpn_1x_scoco_results.pkl ├── faster_rcnn_x101_32x4d_fpn_1x_results.pkl ├── faster_rcnn_x101_64x4d_fpn_1x_results.pkl ├── htc_dconv_c3-c5_mstrain_400_1400_x101_64x4d_fpn_20e_results.pkl ├── mask_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl ├── mask_rcnn_r50_fpn_1x_coco_results.pkl ├── mask_rcnn_r50_fpn_1x_cocoscoco_results.pkl ├── mask_rcnn_r50_fpn_1x_results.pkl ├── mask_rcnn_r50_fpn_1x_scoco_results.pkl └── retinanet_r50_fpn_1x_results.pkl └── pascal_voc ├── faster_rcnn_r50_fpn_1x_svoc0712_results.pkl ├── faster_rcnn_r50_fpn_1x_voc0712_results.pkl ├── faster_rcnn_r50_fpn_1x_vocsvoc0712_results.pkl └── voc_rmse.csv /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/README.md -------------------------------------------------------------------------------- /TABLE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/TABLE.md -------------------------------------------------------------------------------- /data-analysis/Example_Pascal_VOC.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/Example_Pascal_VOC.jpg -------------------------------------------------------------------------------- /data-analysis/calc_rmse.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/calc_rmse.py -------------------------------------------------------------------------------- /data-analysis/data_analysis.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/data_analysis.ipynb -------------------------------------------------------------------------------- /data-analysis/rmse_configs/coco17test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/rmse_configs/coco17test.py -------------------------------------------------------------------------------- /data-analysis/rmse_configs/voc07test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/rmse_configs/voc07test.py -------------------------------------------------------------------------------- /data-analysis/robustness_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/robustness_eval.py -------------------------------------------------------------------------------- /data-analysis/visualize_corruptions.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/data-analysis/visualize_corruptions.ipynb -------------------------------------------------------------------------------- /figures/introduction/traffic_hazards.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/introduction/traffic_hazards.pdf -------------------------------------------------------------------------------- /figures/introduction/traffic_hazards.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/introduction/traffic_hazards.png -------------------------------------------------------------------------------- /figures/methods/stylization_figure.key: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/methods/stylization_figure.key -------------------------------------------------------------------------------- /figures/methods/stylization_figure.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/methods/stylization_figure.pdf -------------------------------------------------------------------------------- /figures/methods/stylization_figure.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/methods/stylization_figure.png -------------------------------------------------------------------------------- /figures/methods/visualize_corruptions_3_cropped.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/methods/visualize_corruptions_3_cropped.pdf -------------------------------------------------------------------------------- /figures/methods/visualize_corruptions_3_cropped.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/methods/visualize_corruptions_3_cropped.png -------------------------------------------------------------------------------- /figures/results/cityscapes_corruption_individual.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/cityscapes_corruption_individual.pdf -------------------------------------------------------------------------------- /figures/results/cityscapes_corruption_overall.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/cityscapes_corruption_overall.pdf -------------------------------------------------------------------------------- /figures/results/coco_corruption_backbones_individual.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/coco_corruption_backbones_individual.pdf -------------------------------------------------------------------------------- /figures/results/coco_corruption_individual.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/coco_corruption_individual.pdf -------------------------------------------------------------------------------- /figures/results/coco_corruption_overall.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/coco_corruption_overall.pdf -------------------------------------------------------------------------------- /figures/results/pascal_corruption_individual.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/pascal_corruption_individual.pdf -------------------------------------------------------------------------------- /figures/results/pascal_corruption_overall.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/pascal_corruption_overall.pdf -------------------------------------------------------------------------------- /figures/results/rpc_vs_rmse.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/figures/results/rpc_vs_rmse.pdf -------------------------------------------------------------------------------- /raw-data/cityscapes/faster_rcnn_r50_fpn_1x_city_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/faster_rcnn_r50_fpn_1x_city_results.pkl -------------------------------------------------------------------------------- /raw-data/cityscapes/faster_rcnn_r50_fpn_1x_cityscity_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/faster_rcnn_r50_fpn_1x_cityscity_results.pkl -------------------------------------------------------------------------------- /raw-data/cityscapes/faster_rcnn_r50_fpn_1x_scity_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/faster_rcnn_r50_fpn_1x_scity_results.pkl -------------------------------------------------------------------------------- /raw-data/cityscapes/mask_rcnn_r50_fpn_1x_city_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/mask_rcnn_r50_fpn_1x_city_results.pkl -------------------------------------------------------------------------------- /raw-data/cityscapes/mask_rcnn_r50_fpn_1x_cityscity_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/mask_rcnn_r50_fpn_1x_cityscity_results.pkl -------------------------------------------------------------------------------- /raw-data/cityscapes/mask_rcnn_r50_fpn_1x_scity_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/cityscapes/mask_rcnn_r50_fpn_1x_scity_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/cascade_mask_rcnn_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/cascade_mask_rcnn_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/cascade_rcnn_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/cascade_rcnn_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/coco_rmse.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/coco_rmse.csv -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_dconv_c3-c5_x101_32x4d_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_dconv_c3-c5_x101_32x4d_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_r101_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_r101_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_r50_fpn_1x_coco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_r50_fpn_1x_coco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_r50_fpn_1x_cocoscoco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_r50_fpn_1x_cocoscoco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_r50_fpn_1x_scoco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_r50_fpn_1x_scoco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_x101_32x4d_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_x101_32x4d_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/faster_rcnn_x101_64x4d_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/faster_rcnn_x101_64x4d_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/htc_dconv_c3-c5_mstrain_400_1400_x101_64x4d_fpn_20e_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/htc_dconv_c3-c5_mstrain_400_1400_x101_64x4d_fpn_20e_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/mask_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/mask_rcnn_dconv_c3-c5_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/mask_rcnn_r50_fpn_1x_coco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/mask_rcnn_r50_fpn_1x_coco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/mask_rcnn_r50_fpn_1x_cocoscoco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/mask_rcnn_r50_fpn_1x_cocoscoco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/mask_rcnn_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/mask_rcnn_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/mask_rcnn_r50_fpn_1x_scoco_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/mask_rcnn_r50_fpn_1x_scoco_results.pkl -------------------------------------------------------------------------------- /raw-data/coco/retinanet_r50_fpn_1x_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/coco/retinanet_r50_fpn_1x_results.pkl -------------------------------------------------------------------------------- /raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_svoc0712_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_svoc0712_results.pkl -------------------------------------------------------------------------------- /raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_voc0712_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_voc0712_results.pkl -------------------------------------------------------------------------------- /raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_vocsvoc0712_results.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/pascal_voc/faster_rcnn_r50_fpn_1x_vocsvoc0712_results.pkl -------------------------------------------------------------------------------- /raw-data/pascal_voc/voc_rmse.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bethgelab/robust-detection-benchmark/HEAD/raw-data/pascal_voc/voc_rmse.csv --------------------------------------------------------------------------------