├── .gitignore ├── LICENSE ├── README.md ├── data └── visual_description.json ├── docs ├── DATA_PREPAER.md ├── GET_STARTED.md ├── INSTALL.md ├── README_CN.md └── figs │ ├── behavior_distribution.png │ ├── bench.png │ ├── cloud.png │ ├── dataset_cases.jpg │ ├── evaluation_types.png │ ├── examples_benchmark_3.png │ ├── examples_benchmark_4.png │ ├── examples_gpt4o_1.png │ ├── examples_gpt4o_2.png │ ├── gpt_rouge_bleu.png │ ├── icons │ ├── behavior.png │ ├── external.png │ ├── human.png │ ├── motion.png │ ├── perception.png │ ├── planning.png │ ├── prediction.png │ ├── robustness.png │ ├── sensor.png │ ├── transmission.png │ └── weather.png │ ├── spatial_distribution.png │ └── teaser.png ├── env.sh ├── evaluate ├── eval.py ├── prompts.py ├── request.py └── utils.py ├── inference ├── llava1.5.py └── utils.py ├── prompt.txt ├── script └── llava1.5-7b.sh └── tools └── preprocess.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/README.md -------------------------------------------------------------------------------- /data/visual_description.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/data/visual_description.json -------------------------------------------------------------------------------- /docs/DATA_PREPAER.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/DATA_PREPAER.md -------------------------------------------------------------------------------- /docs/GET_STARTED.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/GET_STARTED.md -------------------------------------------------------------------------------- /docs/INSTALL.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/INSTALL.md -------------------------------------------------------------------------------- /docs/README_CN.md: -------------------------------------------------------------------------------- 1 | To be updated soon! 2 | -------------------------------------------------------------------------------- /docs/figs/behavior_distribution.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/behavior_distribution.png -------------------------------------------------------------------------------- /docs/figs/bench.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/bench.png -------------------------------------------------------------------------------- /docs/figs/cloud.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/cloud.png -------------------------------------------------------------------------------- /docs/figs/dataset_cases.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/dataset_cases.jpg -------------------------------------------------------------------------------- /docs/figs/evaluation_types.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/evaluation_types.png -------------------------------------------------------------------------------- /docs/figs/examples_benchmark_3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/examples_benchmark_3.png -------------------------------------------------------------------------------- /docs/figs/examples_benchmark_4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/examples_benchmark_4.png -------------------------------------------------------------------------------- /docs/figs/examples_gpt4o_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/examples_gpt4o_1.png -------------------------------------------------------------------------------- /docs/figs/examples_gpt4o_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/examples_gpt4o_2.png -------------------------------------------------------------------------------- /docs/figs/gpt_rouge_bleu.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/gpt_rouge_bleu.png -------------------------------------------------------------------------------- /docs/figs/icons/behavior.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/behavior.png -------------------------------------------------------------------------------- /docs/figs/icons/external.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/external.png -------------------------------------------------------------------------------- /docs/figs/icons/human.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/human.png -------------------------------------------------------------------------------- /docs/figs/icons/motion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/motion.png -------------------------------------------------------------------------------- /docs/figs/icons/perception.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/perception.png -------------------------------------------------------------------------------- /docs/figs/icons/planning.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/planning.png -------------------------------------------------------------------------------- /docs/figs/icons/prediction.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/prediction.png -------------------------------------------------------------------------------- /docs/figs/icons/robustness.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/robustness.png -------------------------------------------------------------------------------- /docs/figs/icons/sensor.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/sensor.png -------------------------------------------------------------------------------- /docs/figs/icons/transmission.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/transmission.png -------------------------------------------------------------------------------- /docs/figs/icons/weather.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/icons/weather.png -------------------------------------------------------------------------------- /docs/figs/spatial_distribution.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/spatial_distribution.png -------------------------------------------------------------------------------- /docs/figs/teaser.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/docs/figs/teaser.png -------------------------------------------------------------------------------- /env.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/env.sh -------------------------------------------------------------------------------- /evaluate/eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/evaluate/eval.py -------------------------------------------------------------------------------- /evaluate/prompts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/evaluate/prompts.py -------------------------------------------------------------------------------- /evaluate/request.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/evaluate/request.py -------------------------------------------------------------------------------- /evaluate/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/evaluate/utils.py -------------------------------------------------------------------------------- /inference/llava1.5.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/inference/llava1.5.py -------------------------------------------------------------------------------- /inference/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/inference/utils.py -------------------------------------------------------------------------------- /prompt.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/prompt.txt -------------------------------------------------------------------------------- /script/llava1.5-7b.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/script/llava1.5-7b.sh -------------------------------------------------------------------------------- /tools/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/worldbench/DriveBench/HEAD/tools/preprocess.py --------------------------------------------------------------------------------