├── README.md └── inference ├── README.md ├── human-eval ├── LICENSE ├── README.md ├── data │ ├── HumanEval.jsonl.gz │ ├── example_problem.jsonl │ └── example_samples.jsonl ├── human_eval.egg-info │ ├── PKG-INFO │ ├── SOURCES.txt │ ├── dependency_links.txt │ ├── entry_points.txt │ ├── requires.txt │ └── top_level.txt ├── human_eval │ ├── __init__.py │ ├── __pycache__ │ │ ├── __init__.cpython-310.pyc │ │ └── data.cpython-310.pyc │ ├── data.py │ ├── evaluate_functional_correctness.py │ ├── evaluation.py │ └── execution.py ├── requirements.txt └── setup.py ├── human_eval_inference.py ├── human_eval_inference └── temperature_0_results_pass@1_75.6.json ├── requirements.txt └── run_inference.sh /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/README.md -------------------------------------------------------------------------------- /inference/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/README.md -------------------------------------------------------------------------------- /inference/human-eval/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/LICENSE -------------------------------------------------------------------------------- /inference/human-eval/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/README.md -------------------------------------------------------------------------------- /inference/human-eval/data/HumanEval.jsonl.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/data/HumanEval.jsonl.gz -------------------------------------------------------------------------------- /inference/human-eval/data/example_problem.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/data/example_problem.jsonl -------------------------------------------------------------------------------- /inference/human-eval/data/example_samples.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/data/example_samples.jsonl -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/PKG-INFO: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval.egg-info/PKG-INFO -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/SOURCES.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval.egg-info/SOURCES.txt -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/dependency_links.txt: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/entry_points.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval.egg-info/entry_points.txt -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/requires.txt: -------------------------------------------------------------------------------- 1 | tqdm 2 | fire 3 | numpy 4 | -------------------------------------------------------------------------------- /inference/human-eval/human_eval.egg-info/top_level.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval.egg-info/top_level.txt -------------------------------------------------------------------------------- /inference/human-eval/human_eval/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /inference/human-eval/human_eval/__pycache__/__init__.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/__pycache__/__init__.cpython-310.pyc -------------------------------------------------------------------------------- /inference/human-eval/human_eval/__pycache__/data.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/__pycache__/data.cpython-310.pyc -------------------------------------------------------------------------------- /inference/human-eval/human_eval/data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/data.py -------------------------------------------------------------------------------- /inference/human-eval/human_eval/evaluate_functional_correctness.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/evaluate_functional_correctness.py -------------------------------------------------------------------------------- /inference/human-eval/human_eval/evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/evaluation.py -------------------------------------------------------------------------------- /inference/human-eval/human_eval/execution.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/human_eval/execution.py -------------------------------------------------------------------------------- /inference/human-eval/requirements.txt: -------------------------------------------------------------------------------- 1 | tqdm 2 | fire 3 | numpy 4 | -------------------------------------------------------------------------------- /inference/human-eval/setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human-eval/setup.py -------------------------------------------------------------------------------- /inference/human_eval_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human_eval_inference.py -------------------------------------------------------------------------------- /inference/human_eval_inference/temperature_0_results_pass@1_75.6.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/human_eval_inference/temperature_0_results_pass@1_75.6.json -------------------------------------------------------------------------------- /inference/requirements.txt: -------------------------------------------------------------------------------- 1 | vllm==0.1.4 2 | ray==2.6.2 3 | transformers==4.31.0 4 | pandas -------------------------------------------------------------------------------- /inference/run_inference.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IDEA-CCNL/Ziya-Coding/HEAD/inference/run_inference.sh --------------------------------------------------------------------------------