├── .github ├── FUNDING.yml ├── issue_templates │ └── invalid_host_config.md └── workflows │ └── validate-and-process.yml ├── .gitignore ├── README.md ├── annotations ├── test_annotations_devsplit.json └── test_annotations_testsplit.json ├── challenge_config.yaml ├── challenge_data ├── __init__.py └── challenge_1 │ ├── __init__.py │ └── main.py ├── evaluation_script ├── __init__.py ├── dependency-installation.md └── main.py ├── github ├── challenge_processing_script.py ├── config.py ├── host_config.json ├── requirements.txt └── utils.py ├── logo.jpg ├── remote_challenge_evaluation ├── README.md ├── eval_ai_interface.py ├── evaluate.py ├── main.py └── requirements.txt ├── run.sh ├── submission.json ├── templates ├── challenge_phase_1_description.html ├── challenge_phase_2_description.html ├── description.html ├── evaluation_details.html ├── submission_guidelines.html └── terms_and_conditions.html └── worker ├── __init__.py └── run.py /.github/FUNDING.yml: -------------------------------------------------------------------------------- 1 | open_collective: evalai 2 | -------------------------------------------------------------------------------- /.github/issue_templates/invalid_host_config.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/.github/issue_templates/invalid_host_config.md -------------------------------------------------------------------------------- /.github/workflows/validate-and-process.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/.github/workflows/validate-and-process.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/README.md -------------------------------------------------------------------------------- /annotations/test_annotations_devsplit.json: -------------------------------------------------------------------------------- 1 | { 2 | "foo": "bar" 3 | } -------------------------------------------------------------------------------- /annotations/test_annotations_testsplit.json: -------------------------------------------------------------------------------- 1 | { 2 | "foo": "bar" 3 | } -------------------------------------------------------------------------------- /challenge_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/challenge_config.yaml -------------------------------------------------------------------------------- /challenge_data/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /challenge_data/challenge_1/__init__.py: -------------------------------------------------------------------------------- 1 | from .main import evaluate 2 | -------------------------------------------------------------------------------- /challenge_data/challenge_1/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/challenge_data/challenge_1/main.py -------------------------------------------------------------------------------- /evaluation_script/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/evaluation_script/__init__.py -------------------------------------------------------------------------------- /evaluation_script/dependency-installation.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/evaluation_script/dependency-installation.md -------------------------------------------------------------------------------- /evaluation_script/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/evaluation_script/main.py -------------------------------------------------------------------------------- /github/challenge_processing_script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/github/challenge_processing_script.py -------------------------------------------------------------------------------- /github/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/github/config.py -------------------------------------------------------------------------------- /github/host_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/github/host_config.json -------------------------------------------------------------------------------- /github/requirements.txt: -------------------------------------------------------------------------------- 1 | PyGithub===1.53 2 | requests==2.32.4 3 | -------------------------------------------------------------------------------- /github/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/github/utils.py -------------------------------------------------------------------------------- /logo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/logo.jpg -------------------------------------------------------------------------------- /remote_challenge_evaluation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/remote_challenge_evaluation/README.md -------------------------------------------------------------------------------- /remote_challenge_evaluation/eval_ai_interface.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/remote_challenge_evaluation/eval_ai_interface.py -------------------------------------------------------------------------------- /remote_challenge_evaluation/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/remote_challenge_evaluation/evaluate.py -------------------------------------------------------------------------------- /remote_challenge_evaluation/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/remote_challenge_evaluation/main.py -------------------------------------------------------------------------------- /remote_challenge_evaluation/requirements.txt: -------------------------------------------------------------------------------- 1 | requests==2.32.4 -------------------------------------------------------------------------------- /run.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/run.sh -------------------------------------------------------------------------------- /submission.json: -------------------------------------------------------------------------------- 1 | {} 2 | -------------------------------------------------------------------------------- /templates/challenge_phase_1_description.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/challenge_phase_1_description.html -------------------------------------------------------------------------------- /templates/challenge_phase_2_description.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/challenge_phase_2_description.html -------------------------------------------------------------------------------- /templates/description.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/description.html -------------------------------------------------------------------------------- /templates/evaluation_details.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/evaluation_details.html -------------------------------------------------------------------------------- /templates/submission_guidelines.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/submission_guidelines.html -------------------------------------------------------------------------------- /templates/terms_and_conditions.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/templates/terms_and_conditions.html -------------------------------------------------------------------------------- /worker/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /worker/run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cloud-CV/EvalAI-Starters/HEAD/worker/run.py --------------------------------------------------------------------------------