├── .gitignore ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── configs ├── experiment_config.jsonc └── experiment_mixture_config.jsonc ├── custom_explainers ├── __init__.py ├── breakdown.py ├── ground_truth_shap.py ├── l2x.py ├── lime.py ├── maple.py ├── random.py ├── shap.py └── shapr.py ├── custom_metrics ├── __init__.py ├── faithfulness.py ├── infidelity.py ├── mi.py ├── monotonicity.py ├── roar.py ├── roar_faithfulness.py ├── roar_monotonicity.py ├── shapley.py └── shapley_corr.py ├── img ├── banner.svg ├── overview_figure.pdf ├── overview_figure.png └── overview_figure.svg ├── main_driver.py ├── other ├── access_old_experiment.py ├── model_wine.py ├── model_wine_experiment.py └── real_dataset_modelling.py ├── plotting └── generate_plots.py ├── requirements.txt ├── results └── .keep ├── script.sh ├── src ├── __init__.py ├── datasets.py ├── experiments.py ├── explainer.py ├── metric.py ├── model.py └── parse_utils.py └── synthetic_datasets ├── __init__.py ├── custom_dataset.py ├── synthetic_gaussian.py ├── synthetic_mixture.py └── synthetic_multinomial.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/.gitignore -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/README.md -------------------------------------------------------------------------------- /configs/experiment_config.jsonc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/configs/experiment_config.jsonc -------------------------------------------------------------------------------- /configs/experiment_mixture_config.jsonc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/configs/experiment_mixture_config.jsonc -------------------------------------------------------------------------------- /custom_explainers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/__init__.py -------------------------------------------------------------------------------- /custom_explainers/breakdown.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/breakdown.py -------------------------------------------------------------------------------- /custom_explainers/ground_truth_shap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/ground_truth_shap.py -------------------------------------------------------------------------------- /custom_explainers/l2x.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/l2x.py -------------------------------------------------------------------------------- /custom_explainers/lime.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/lime.py -------------------------------------------------------------------------------- /custom_explainers/maple.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/maple.py -------------------------------------------------------------------------------- /custom_explainers/random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/random.py -------------------------------------------------------------------------------- /custom_explainers/shap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/shap.py -------------------------------------------------------------------------------- /custom_explainers/shapr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_explainers/shapr.py -------------------------------------------------------------------------------- /custom_metrics/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/__init__.py -------------------------------------------------------------------------------- /custom_metrics/faithfulness.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/faithfulness.py -------------------------------------------------------------------------------- /custom_metrics/infidelity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/infidelity.py -------------------------------------------------------------------------------- /custom_metrics/mi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/mi.py -------------------------------------------------------------------------------- /custom_metrics/monotonicity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/monotonicity.py -------------------------------------------------------------------------------- /custom_metrics/roar.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/roar.py -------------------------------------------------------------------------------- /custom_metrics/roar_faithfulness.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/roar_faithfulness.py -------------------------------------------------------------------------------- /custom_metrics/roar_monotonicity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/roar_monotonicity.py -------------------------------------------------------------------------------- /custom_metrics/shapley.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/shapley.py -------------------------------------------------------------------------------- /custom_metrics/shapley_corr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/custom_metrics/shapley_corr.py -------------------------------------------------------------------------------- /img/banner.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/img/banner.svg -------------------------------------------------------------------------------- /img/overview_figure.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/img/overview_figure.pdf -------------------------------------------------------------------------------- /img/overview_figure.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/img/overview_figure.png -------------------------------------------------------------------------------- /img/overview_figure.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/img/overview_figure.svg -------------------------------------------------------------------------------- /main_driver.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/main_driver.py -------------------------------------------------------------------------------- /other/access_old_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/other/access_old_experiment.py -------------------------------------------------------------------------------- /other/model_wine.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/other/model_wine.py -------------------------------------------------------------------------------- /other/model_wine_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/other/model_wine_experiment.py -------------------------------------------------------------------------------- /other/real_dataset_modelling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/other/real_dataset_modelling.py -------------------------------------------------------------------------------- /plotting/generate_plots.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/plotting/generate_plots.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/requirements.txt -------------------------------------------------------------------------------- /results/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /script.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/script.sh -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/datasets.py -------------------------------------------------------------------------------- /src/experiments.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/experiments.py -------------------------------------------------------------------------------- /src/explainer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/explainer.py -------------------------------------------------------------------------------- /src/metric.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/metric.py -------------------------------------------------------------------------------- /src/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/model.py -------------------------------------------------------------------------------- /src/parse_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/src/parse_utils.py -------------------------------------------------------------------------------- /synthetic_datasets/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/synthetic_datasets/__init__.py -------------------------------------------------------------------------------- /synthetic_datasets/custom_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/synthetic_datasets/custom_dataset.py -------------------------------------------------------------------------------- /synthetic_datasets/synthetic_gaussian.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/synthetic_datasets/synthetic_gaussian.py -------------------------------------------------------------------------------- /synthetic_datasets/synthetic_mixture.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/synthetic_datasets/synthetic_mixture.py -------------------------------------------------------------------------------- /synthetic_datasets/synthetic_multinomial.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/abacusai/xai-bench/HEAD/synthetic_datasets/synthetic_multinomial.py --------------------------------------------------------------------------------