├── .gitignore ├── LICENSE ├── README.md ├── SUMMARY.md ├── baseline-runner └── baseline_runner.py ├── dataset-generator ├── README.md ├── base_scraper.py ├── checkout_sources.py ├── curate_dataset.py ├── models.py ├── pytest.ini ├── requirements.txt ├── scraper.py ├── scraper_factory.py ├── scrapers │ ├── cantina_scraper.py │ ├── code4rena_scraper.py │ └── sherlock_scraper.py └── test │ ├── README.md │ ├── run_tests.py │ ├── test_base_scraper.py │ ├── test_models.py │ ├── test_scraper_factory.py │ ├── test_scrapers.py │ └── testdata │ ├── cantina-audit-page-unichain.html │ ├── cantina-portfolio.html │ ├── cantina-sonic.html │ ├── cantina_uniswap_unichain_2_october2024.pdf │ ├── codearena-2025-04-virtuals-protocol.html │ ├── codearena-blackhole.html │ ├── codearena-reports.html │ ├── codearena-upside.html │ ├── input-data.txt │ ├── sherlock-audits.html │ └── sherlock-metalend.pdf ├── datasets └── curated-2025-08-18 │ ├── baseline-results │ ├── baseline_cantina_minimal-delegation_2025_04.json │ ├── baseline_cantina_smart-contract-audit-of-tn-contracts_2025_08.json │ ├── baseline_code4rena_bakerfi-invitational_2025_02.json │ ├── baseline_code4rena_blackhole_2025_07.json │ ├── baseline_code4rena_cabal-liquid-staking-token_2025_05.json │ ├── baseline_code4rena_coded-estate-invitational_2024_12.json │ ├── baseline_code4rena_fenix-finance-invitational_2024_10.json │ ├── baseline_code4rena_forte-float128-solidity-library_2025_04.json │ ├── baseline_code4rena_initia-move_2025_04.json │ ├── baseline_code4rena_iq-ai_2025_03.json │ ├── baseline_code4rena_kinetiq_2025_07.json │ ├── baseline_code4rena_lambowin_2025_02.json │ ├── baseline_code4rena_liquid-ron_2025_03.json │ ├── baseline_code4rena_loopfi_2025_02.json │ ├── baseline_code4rena_mantra-dex_2025_03.json │ ├── baseline_code4rena_next-generation_2025_05.json │ ├── baseline_code4rena_pump-science_2025_02.json │ ├── baseline_code4rena_secondswap_2025_02.json │ ├── baseline_code4rena_starknet-perpetual_2025_06.json │ ├── baseline_code4rena_superposition_2025_01.json │ ├── baseline_code4rena_virtuals-protocol_2025_08.json │ ├── baseline_sherlock_20240913---final---perennial-v2-update-3-audit-report_2024_09.json │ ├── baseline_sherlock_20240920---final---boost-core-incentive-protocol-audit-report_2024_09.json │ ├── baseline_sherlock_axion_2025_01.json │ ├── baseline_sherlock_cork-protocol_2025_01.json │ ├── baseline_sherlock_crestal-network_2025_03.json │ ├── baseline_sherlock_idle-finance_2024_12.json │ ├── baseline_sherlock_morph-l-2_2024_09.json │ ├── baseline_sherlock_oku_2024_12.json │ ├── baseline_sherlock_symmio_2025_03.json │ └── baseline_sherlock_tally_2024_12.json │ └── curated-2025-08-18.json ├── requirements.txt ├── scoring ├── report_generator.py └── scorer_v2.py └── tests ├── test_checkout.py └── test_integration.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/README.md -------------------------------------------------------------------------------- /SUMMARY.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/SUMMARY.md -------------------------------------------------------------------------------- /baseline-runner/baseline_runner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/baseline-runner/baseline_runner.py -------------------------------------------------------------------------------- /dataset-generator/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/README.md -------------------------------------------------------------------------------- /dataset-generator/base_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/base_scraper.py -------------------------------------------------------------------------------- /dataset-generator/checkout_sources.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/checkout_sources.py -------------------------------------------------------------------------------- /dataset-generator/curate_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/curate_dataset.py -------------------------------------------------------------------------------- /dataset-generator/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/models.py -------------------------------------------------------------------------------- /dataset-generator/pytest.ini: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/pytest.ini -------------------------------------------------------------------------------- /dataset-generator/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/requirements.txt -------------------------------------------------------------------------------- /dataset-generator/scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/scraper.py -------------------------------------------------------------------------------- /dataset-generator/scraper_factory.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/scraper_factory.py -------------------------------------------------------------------------------- /dataset-generator/scrapers/cantina_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/scrapers/cantina_scraper.py -------------------------------------------------------------------------------- /dataset-generator/scrapers/code4rena_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/scrapers/code4rena_scraper.py -------------------------------------------------------------------------------- /dataset-generator/scrapers/sherlock_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/scrapers/sherlock_scraper.py -------------------------------------------------------------------------------- /dataset-generator/test/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/README.md -------------------------------------------------------------------------------- /dataset-generator/test/run_tests.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/run_tests.py -------------------------------------------------------------------------------- /dataset-generator/test/test_base_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/test_base_scraper.py -------------------------------------------------------------------------------- /dataset-generator/test/test_models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/test_models.py -------------------------------------------------------------------------------- /dataset-generator/test/test_scraper_factory.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/test_scraper_factory.py -------------------------------------------------------------------------------- /dataset-generator/test/test_scrapers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/test_scrapers.py -------------------------------------------------------------------------------- /dataset-generator/test/testdata/cantina-audit-page-unichain.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/cantina-audit-page-unichain.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/cantina-portfolio.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/cantina-portfolio.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/cantina-sonic.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/cantina-sonic.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/cantina_uniswap_unichain_2_october2024.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/cantina_uniswap_unichain_2_october2024.pdf -------------------------------------------------------------------------------- /dataset-generator/test/testdata/codearena-2025-04-virtuals-protocol.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/codearena-2025-04-virtuals-protocol.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/codearena-blackhole.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/codearena-blackhole.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/codearena-reports.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/codearena-reports.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/codearena-upside.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/codearena-upside.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/input-data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/input-data.txt -------------------------------------------------------------------------------- /dataset-generator/test/testdata/sherlock-audits.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/sherlock-audits.html -------------------------------------------------------------------------------- /dataset-generator/test/testdata/sherlock-metalend.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/dataset-generator/test/testdata/sherlock-metalend.pdf -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_cantina_minimal-delegation_2025_04.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_cantina_minimal-delegation_2025_04.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_cantina_smart-contract-audit-of-tn-contracts_2025_08.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_cantina_smart-contract-audit-of-tn-contracts_2025_08.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_bakerfi-invitational_2025_02.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_bakerfi-invitational_2025_02.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_blackhole_2025_07.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_blackhole_2025_07.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_cabal-liquid-staking-token_2025_05.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_cabal-liquid-staking-token_2025_05.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_coded-estate-invitational_2024_12.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_coded-estate-invitational_2024_12.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_fenix-finance-invitational_2024_10.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_fenix-finance-invitational_2024_10.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_forte-float128-solidity-library_2025_04.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_forte-float128-solidity-library_2025_04.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_initia-move_2025_04.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_initia-move_2025_04.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_iq-ai_2025_03.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_iq-ai_2025_03.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_kinetiq_2025_07.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_kinetiq_2025_07.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_lambowin_2025_02.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_lambowin_2025_02.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_liquid-ron_2025_03.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_liquid-ron_2025_03.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_loopfi_2025_02.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_loopfi_2025_02.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_mantra-dex_2025_03.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_mantra-dex_2025_03.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_next-generation_2025_05.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_next-generation_2025_05.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_pump-science_2025_02.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_pump-science_2025_02.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_secondswap_2025_02.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_secondswap_2025_02.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_starknet-perpetual_2025_06.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_starknet-perpetual_2025_06.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_superposition_2025_01.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_superposition_2025_01.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_code4rena_virtuals-protocol_2025_08.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_code4rena_virtuals-protocol_2025_08.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_20240913---final---perennial-v2-update-3-audit-report_2024_09.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_20240913---final---perennial-v2-update-3-audit-report_2024_09.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_20240920---final---boost-core-incentive-protocol-audit-report_2024_09.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_20240920---final---boost-core-incentive-protocol-audit-report_2024_09.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_axion_2025_01.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_axion_2025_01.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_cork-protocol_2025_01.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_cork-protocol_2025_01.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_crestal-network_2025_03.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_crestal-network_2025_03.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_idle-finance_2024_12.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_idle-finance_2024_12.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_morph-l-2_2024_09.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_morph-l-2_2024_09.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_oku_2024_12.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_oku_2024_12.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_symmio_2025_03.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_symmio_2025_03.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/baseline-results/baseline_sherlock_tally_2024_12.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/baseline-results/baseline_sherlock_tally_2024_12.json -------------------------------------------------------------------------------- /datasets/curated-2025-08-18/curated-2025-08-18.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/datasets/curated-2025-08-18/curated-2025-08-18.json -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/requirements.txt -------------------------------------------------------------------------------- /scoring/report_generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/scoring/report_generator.py -------------------------------------------------------------------------------- /scoring/scorer_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/scoring/scorer_v2.py -------------------------------------------------------------------------------- /tests/test_checkout.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/tests/test_checkout.py -------------------------------------------------------------------------------- /tests/test_integration.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/scabench-org/scabench/HEAD/tests/test_integration.py --------------------------------------------------------------------------------