├── .github └── workflows │ └── docker-image.yml ├── .gitignore ├── LICENSE ├── README.md ├── challenge_dataset.py ├── dataset_config_generator.py ├── dataset_configs ├── benchmark.json ├── challenge.json └── example.json ├── evaluation ├── benchmark_metrics.ipynb ├── challenge_batchnorm.ipynb ├── challenge_metrics.ipynb └── inspect_misclassifications.ipynb ├── figures ├── Plot Spectra.ipynb ├── Plot Variations.ipynb ├── README.md ├── batch_normalization_loss.png ├── challenge_accuracies.png ├── class_variation.png ├── cnn2_164_281.png ├── cnn6_164_281.png ├── comparison_spectra.png ├── comparison_spectra_zoom.png ├── height_split.png ├── inc6_164_281.png ├── loss_cnn2_cnnbn.png ├── loss_cnn2_resnet.png ├── minor_peak_overlook.png ├── misclassifications.png └── position_overlap.png ├── model_implementations ├── README.md ├── __init__.py ├── basic_blocks.py ├── ho.py ├── lee.py ├── liu.py ├── modifications.py ├── szymanski.py └── wang.py ├── requirements.txt ├── spectra_from_config.py └── training ├── benchmark.dockerfile ├── benchmark.py ├── benchmark.sh ├── challenge_activations.dockerfile ├── challenge_activations.py ├── challenge_activations.sh ├── challenge_modifications.dockerfile ├── challenge_modifications.py └── challenge_modifications.sh /.github/workflows/docker-image.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/.github/workflows/docker-image.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/README.md -------------------------------------------------------------------------------- /challenge_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/challenge_dataset.py -------------------------------------------------------------------------------- /dataset_config_generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/dataset_config_generator.py -------------------------------------------------------------------------------- /dataset_configs/benchmark.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/dataset_configs/benchmark.json -------------------------------------------------------------------------------- /dataset_configs/challenge.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/dataset_configs/challenge.json -------------------------------------------------------------------------------- /dataset_configs/example.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/dataset_configs/example.json -------------------------------------------------------------------------------- /evaluation/benchmark_metrics.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/evaluation/benchmark_metrics.ipynb -------------------------------------------------------------------------------- /evaluation/challenge_batchnorm.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/evaluation/challenge_batchnorm.ipynb -------------------------------------------------------------------------------- /evaluation/challenge_metrics.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/evaluation/challenge_metrics.ipynb -------------------------------------------------------------------------------- /evaluation/inspect_misclassifications.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/evaluation/inspect_misclassifications.ipynb -------------------------------------------------------------------------------- /figures/Plot Spectra.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/Plot Spectra.ipynb -------------------------------------------------------------------------------- /figures/Plot Variations.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/Plot Variations.ipynb -------------------------------------------------------------------------------- /figures/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/README.md -------------------------------------------------------------------------------- /figures/batch_normalization_loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/batch_normalization_loss.png -------------------------------------------------------------------------------- /figures/challenge_accuracies.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/challenge_accuracies.png -------------------------------------------------------------------------------- /figures/class_variation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/class_variation.png -------------------------------------------------------------------------------- /figures/cnn2_164_281.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/cnn2_164_281.png -------------------------------------------------------------------------------- /figures/cnn6_164_281.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/cnn6_164_281.png -------------------------------------------------------------------------------- /figures/comparison_spectra.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/comparison_spectra.png -------------------------------------------------------------------------------- /figures/comparison_spectra_zoom.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/comparison_spectra_zoom.png -------------------------------------------------------------------------------- /figures/height_split.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/height_split.png -------------------------------------------------------------------------------- /figures/inc6_164_281.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/inc6_164_281.png -------------------------------------------------------------------------------- /figures/loss_cnn2_cnnbn.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/loss_cnn2_cnnbn.png -------------------------------------------------------------------------------- /figures/loss_cnn2_resnet.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/loss_cnn2_resnet.png -------------------------------------------------------------------------------- /figures/minor_peak_overlook.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/minor_peak_overlook.png -------------------------------------------------------------------------------- /figures/misclassifications.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/misclassifications.png -------------------------------------------------------------------------------- /figures/position_overlap.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/figures/position_overlap.png -------------------------------------------------------------------------------- /model_implementations/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/README.md -------------------------------------------------------------------------------- /model_implementations/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/__init__.py -------------------------------------------------------------------------------- /model_implementations/basic_blocks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/basic_blocks.py -------------------------------------------------------------------------------- /model_implementations/ho.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/ho.py -------------------------------------------------------------------------------- /model_implementations/lee.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/lee.py -------------------------------------------------------------------------------- /model_implementations/liu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/liu.py -------------------------------------------------------------------------------- /model_implementations/modifications.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/modifications.py -------------------------------------------------------------------------------- /model_implementations/szymanski.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/szymanski.py -------------------------------------------------------------------------------- /model_implementations/wang.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/model_implementations/wang.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | tensorflow==2.9.1 2 | scipy 3 | matplotlib 4 | seaborn 5 | wandb 6 | tqdm -------------------------------------------------------------------------------- /spectra_from_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/spectra_from_config.py -------------------------------------------------------------------------------- /training/benchmark.dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/benchmark.dockerfile -------------------------------------------------------------------------------- /training/benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/benchmark.py -------------------------------------------------------------------------------- /training/benchmark.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/benchmark.sh -------------------------------------------------------------------------------- /training/challenge_activations.dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_activations.dockerfile -------------------------------------------------------------------------------- /training/challenge_activations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_activations.py -------------------------------------------------------------------------------- /training/challenge_activations.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_activations.sh -------------------------------------------------------------------------------- /training/challenge_modifications.dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_modifications.dockerfile -------------------------------------------------------------------------------- /training/challenge_modifications.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_modifications.py -------------------------------------------------------------------------------- /training/challenge_modifications.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jschuetzke/synthetic-spectra-benchmark/HEAD/training/challenge_modifications.sh --------------------------------------------------------------------------------