├── LICENSE ├── README.md ├── check_translation_quality.ipynb ├── data ├── HumanEval.jsonl ├── v0 │ └── KR_HumanEval.jsonl └── v1 │ └── KR_HumanEval.jsonl ├── translate.py └── utils ├── __pycache__ ├── execution.cpython-39.pyc └── utils.cpython-39.pyc ├── evaluate_functional_correctness.py ├── evaluation.py ├── execution.py └── utils.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/README.md -------------------------------------------------------------------------------- /check_translation_quality.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/check_translation_quality.ipynb -------------------------------------------------------------------------------- /data/HumanEval.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/data/HumanEval.jsonl -------------------------------------------------------------------------------- /data/v0/KR_HumanEval.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/data/v0/KR_HumanEval.jsonl -------------------------------------------------------------------------------- /data/v1/KR_HumanEval.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/data/v1/KR_HumanEval.jsonl -------------------------------------------------------------------------------- /translate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/translate.py -------------------------------------------------------------------------------- /utils/__pycache__/execution.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/__pycache__/execution.cpython-39.pyc -------------------------------------------------------------------------------- /utils/__pycache__/utils.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/__pycache__/utils.cpython-39.pyc -------------------------------------------------------------------------------- /utils/evaluate_functional_correctness.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/evaluate_functional_correctness.py -------------------------------------------------------------------------------- /utils/evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/evaluation.py -------------------------------------------------------------------------------- /utils/execution.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/execution.py -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HYU-NLP/KR-HumanEval/HEAD/utils/utils.py --------------------------------------------------------------------------------