├── .dockerignore ├── .gitignore ├── .pre-commit-config.yaml ├── Dockerfile ├── LICENSE ├── README.md ├── codegen ├── generate.py └── model.py ├── evoeval ├── __init__.py ├── data.py ├── eval_test │ ├── __init__.py │ ├── _creative_special_oracle.py │ ├── _difficult_special_oracle.py │ ├── _he_special_oracle.py │ └── _subtle_special_oracle.py ├── evaluate.py └── util │ └── api_request.py ├── pyproject.toml ├── requirements.txt ├── resources ├── butterfly_dark.png └── example.gif ├── setup.cfg └── tool └── sanitize.py /.dockerignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/.dockerignore -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/.gitignore -------------------------------------------------------------------------------- /.pre-commit-config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/.pre-commit-config.yaml -------------------------------------------------------------------------------- /Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/Dockerfile -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/README.md -------------------------------------------------------------------------------- /codegen/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/codegen/generate.py -------------------------------------------------------------------------------- /codegen/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/codegen/model.py -------------------------------------------------------------------------------- /evoeval/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/__init__.py -------------------------------------------------------------------------------- /evoeval/data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/data.py -------------------------------------------------------------------------------- /evoeval/eval_test/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/eval_test/__init__.py -------------------------------------------------------------------------------- /evoeval/eval_test/_creative_special_oracle.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/eval_test/_creative_special_oracle.py -------------------------------------------------------------------------------- /evoeval/eval_test/_difficult_special_oracle.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/eval_test/_difficult_special_oracle.py -------------------------------------------------------------------------------- /evoeval/eval_test/_he_special_oracle.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/eval_test/_he_special_oracle.py -------------------------------------------------------------------------------- /evoeval/eval_test/_subtle_special_oracle.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/eval_test/_subtle_special_oracle.py -------------------------------------------------------------------------------- /evoeval/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/evaluate.py -------------------------------------------------------------------------------- /evoeval/util/api_request.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/evoeval/util/api_request.py -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/pyproject.toml -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/requirements.txt -------------------------------------------------------------------------------- /resources/butterfly_dark.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/resources/butterfly_dark.png -------------------------------------------------------------------------------- /resources/example.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/resources/example.gif -------------------------------------------------------------------------------- /setup.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/setup.cfg -------------------------------------------------------------------------------- /tool/sanitize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/evo-eval/evoeval/HEAD/tool/sanitize.py --------------------------------------------------------------------------------