├── LICENSE ├── MODEL_LICENSE ├── README.md ├── README_CN.md ├── aiXcoder_extended_dataset ├── aiXcoder_extended_cplus.jsonl ├── aiXcoder_extended_java.jsonl ├── aiXcoder_extended_javascript.jsonl └── aiXcoder_extended_python.jsonl ├── assets ├── .DS_Store ├── graphviz.svg ├── main_supported_lang.txt ├── table_1.png ├── table_2.png ├── table_3.png ├── table_4.png ├── table_5.png ├── table_6.png ├── table_7.png ├── table_8.png ├── wechat_1.jpg └── wechat_2.jpg ├── finetune.py ├── hf_mini ├── filter.py └── utils.py ├── megatron_mini ├── __init__.py ├── arguments.py ├── core │ ├── __init__.py │ ├── parallel_state.py │ ├── tensor_parallel │ │ ├── __init__.py │ │ ├── layers.py │ │ ├── mappings.py │ │ ├── random.py │ │ └── utils.py │ └── utils.py ├── filter.py ├── global_vars.py ├── initialize.py ├── model │ ├── __init__.py │ ├── llama_model.py │ ├── module.py │ └── transformer.py └── utils.py ├── requirements.txt ├── requirements_peft.txt ├── sess_huggingface.py └── sess_megatron.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/LICENSE -------------------------------------------------------------------------------- /MODEL_LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/MODEL_LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/README.md -------------------------------------------------------------------------------- /README_CN.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/README_CN.md -------------------------------------------------------------------------------- /aiXcoder_extended_dataset/aiXcoder_extended_cplus.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/aiXcoder_extended_dataset/aiXcoder_extended_cplus.jsonl -------------------------------------------------------------------------------- /aiXcoder_extended_dataset/aiXcoder_extended_java.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/aiXcoder_extended_dataset/aiXcoder_extended_java.jsonl -------------------------------------------------------------------------------- /aiXcoder_extended_dataset/aiXcoder_extended_javascript.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/aiXcoder_extended_dataset/aiXcoder_extended_javascript.jsonl -------------------------------------------------------------------------------- /aiXcoder_extended_dataset/aiXcoder_extended_python.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/aiXcoder_extended_dataset/aiXcoder_extended_python.jsonl -------------------------------------------------------------------------------- /assets/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/.DS_Store -------------------------------------------------------------------------------- /assets/graphviz.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/graphviz.svg -------------------------------------------------------------------------------- /assets/main_supported_lang.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/main_supported_lang.txt -------------------------------------------------------------------------------- /assets/table_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_1.png -------------------------------------------------------------------------------- /assets/table_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_2.png -------------------------------------------------------------------------------- /assets/table_3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_3.png -------------------------------------------------------------------------------- /assets/table_4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_4.png -------------------------------------------------------------------------------- /assets/table_5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_5.png -------------------------------------------------------------------------------- /assets/table_6.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_6.png -------------------------------------------------------------------------------- /assets/table_7.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_7.png -------------------------------------------------------------------------------- /assets/table_8.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/table_8.png -------------------------------------------------------------------------------- /assets/wechat_1.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/wechat_1.jpg -------------------------------------------------------------------------------- /assets/wechat_2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/assets/wechat_2.jpg -------------------------------------------------------------------------------- /finetune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/finetune.py -------------------------------------------------------------------------------- /hf_mini/filter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/hf_mini/filter.py -------------------------------------------------------------------------------- /hf_mini/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/hf_mini/utils.py -------------------------------------------------------------------------------- /megatron_mini/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/__init__.py -------------------------------------------------------------------------------- /megatron_mini/arguments.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/arguments.py -------------------------------------------------------------------------------- /megatron_mini/core/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/__init__.py -------------------------------------------------------------------------------- /megatron_mini/core/parallel_state.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/parallel_state.py -------------------------------------------------------------------------------- /megatron_mini/core/tensor_parallel/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/tensor_parallel/__init__.py -------------------------------------------------------------------------------- /megatron_mini/core/tensor_parallel/layers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/tensor_parallel/layers.py -------------------------------------------------------------------------------- /megatron_mini/core/tensor_parallel/mappings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/tensor_parallel/mappings.py -------------------------------------------------------------------------------- /megatron_mini/core/tensor_parallel/random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/tensor_parallel/random.py -------------------------------------------------------------------------------- /megatron_mini/core/tensor_parallel/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/tensor_parallel/utils.py -------------------------------------------------------------------------------- /megatron_mini/core/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/core/utils.py -------------------------------------------------------------------------------- /megatron_mini/filter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/filter.py -------------------------------------------------------------------------------- /megatron_mini/global_vars.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/global_vars.py -------------------------------------------------------------------------------- /megatron_mini/initialize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/initialize.py -------------------------------------------------------------------------------- /megatron_mini/model/__init__.py: -------------------------------------------------------------------------------- 1 | from .llama_model import LLaMAModel 2 | -------------------------------------------------------------------------------- /megatron_mini/model/llama_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/model/llama_model.py -------------------------------------------------------------------------------- /megatron_mini/model/module.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/model/module.py -------------------------------------------------------------------------------- /megatron_mini/model/transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/model/transformer.py -------------------------------------------------------------------------------- /megatron_mini/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/megatron_mini/utils.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/requirements.txt -------------------------------------------------------------------------------- /requirements_peft.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/requirements_peft.txt -------------------------------------------------------------------------------- /sess_huggingface.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/sess_huggingface.py -------------------------------------------------------------------------------- /sess_megatron.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aixcoder-plugin/aiXcoder-7B/HEAD/sess_megatron.py --------------------------------------------------------------------------------