├── .gitignore ├── LICENSE ├── MODEL_LICENSE ├── README.md ├── README_zh.md ├── benchmark.py ├── configs ├── model_glm_130b.sh ├── model_glm_130b_int4.sh ├── model_glm_130b_int8.sh └── model_glm_130b_v100.sh ├── cuda ├── Makefile └── quantization.cu ├── docs ├── evaluate-your-own-tasks.md ├── inference-with-fastertransformer.md ├── low-resource-inference.md ├── media │ └── 16613396005977.jpg └── quantization.md ├── evaluate.py ├── evaluation ├── __init__.py ├── configs.py ├── dataset.py ├── metrics.py ├── model.py ├── tasks.py └── utils.py ├── generate.py ├── generation ├── __init__.py └── strategies.py ├── initialize.py ├── kernels ├── __init__.py └── quantization.fatbin ├── logs ├── README.md ├── main-log-en.md └── main-log.md ├── quantization ├── __init__.py ├── functional.py └── layers.py ├── requirements.txt ├── resources ├── 03DF31017FE184DB45D41DFFC6F80EF0.png ├── 33872E48D3539EA132B74BCF5EFF458F.png ├── 49BF334CB352BAA19F7D55460B1DBCA9.gif ├── 7CB441707D1035B2890AA2164C5B6EAC.png ├── 7D6433A42D189E2E6FBC62BE066BCE91.png ├── 849024E93FA85347F7F6443932911922.png ├── AE18F14396E2D22BC0BC8DD77EFD3414.png ├── E42321373D22DE198231279B5856BB42.png ├── F48B69263360688CCA21E915F4B1A98B.png ├── WECHAT.md ├── multitask_list.txt └── wechat.jpg ├── scripts ├── benchmark.sh ├── evaluate.sh ├── evaluate_multiple_node.sh └── generate.sh ├── tasks ├── bloom │ ├── glue_cola.yaml │ ├── glue_mnli.yaml │ ├── glue_qnli.yaml │ ├── glue_wnli.yaml │ ├── math_qa.yaml │ ├── mc_taco.yaml │ ├── openbook_qa.yaml │ ├── pubmed_qa.yaml │ ├── superglue_axb.yaml │ └── superglue_axg.yaml ├── chinese │ ├── clue │ │ ├── afqmc.yaml │ │ ├── c3.yaml │ │ ├── cluewsc.yaml │ │ ├── cmnli.yaml │ │ ├── cmrc2018.yaml │ │ ├── csl.yaml │ │ ├── drcd.yaml │ │ └── ocnli.yaml │ └── fewclue │ │ ├── bustm.yaml │ │ ├── chidf.yaml │ │ ├── cluewscf.yaml │ │ ├── cslf.yaml │ │ ├── eprstmt.yaml │ │ └── ocnlif.yaml ├── ethnic │ ├── crows-pair │ │ ├── crows-pair.yaml │ │ └── tasks.py │ ├── ethos │ │ ├── ethos-fewshot-multi.yaml │ │ ├── ethos-fewshot-single.yaml │ │ ├── ethos-oneshot.yaml │ │ └── ethos-zeroshot.yaml │ └── stereoset │ │ ├── stereoset.yaml │ │ └── tasks.py ├── lambada │ ├── lambada-unidirectional.yaml │ ├── lambada.yaml │ ├── strategy.py │ └── task.py ├── language-modeling │ ├── pile.py │ ├── pile.yaml │ ├── ptb.yaml │ ├── wikitext-103.yaml │ └── wikitext-2.yaml └── mmlu │ ├── mmlu.yaml │ └── task.py └── tools ├── __init__.py ├── convert_tp.py └── tokenize_pile.py /.gitignore: -------------------------------------------------------------------------------- 1 | data 2 | __pycache__ 3 | samples 4 | .DS_Store 5 | .idea 6 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/LICENSE -------------------------------------------------------------------------------- /MODEL_LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/MODEL_LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/README.md -------------------------------------------------------------------------------- /README_zh.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/README_zh.md -------------------------------------------------------------------------------- /benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/benchmark.py -------------------------------------------------------------------------------- /configs/model_glm_130b.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/configs/model_glm_130b.sh -------------------------------------------------------------------------------- /configs/model_glm_130b_int4.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/configs/model_glm_130b_int4.sh -------------------------------------------------------------------------------- /configs/model_glm_130b_int8.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/configs/model_glm_130b_int8.sh -------------------------------------------------------------------------------- /configs/model_glm_130b_v100.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/configs/model_glm_130b_v100.sh -------------------------------------------------------------------------------- /cuda/Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/cuda/Makefile -------------------------------------------------------------------------------- /cuda/quantization.cu: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/cuda/quantization.cu -------------------------------------------------------------------------------- /docs/evaluate-your-own-tasks.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/docs/evaluate-your-own-tasks.md -------------------------------------------------------------------------------- /docs/inference-with-fastertransformer.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/docs/inference-with-fastertransformer.md -------------------------------------------------------------------------------- /docs/low-resource-inference.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/docs/low-resource-inference.md -------------------------------------------------------------------------------- /docs/media/16613396005977.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/docs/media/16613396005977.jpg -------------------------------------------------------------------------------- /docs/quantization.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/docs/quantization.md -------------------------------------------------------------------------------- /evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluate.py -------------------------------------------------------------------------------- /evaluation/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/__init__.py -------------------------------------------------------------------------------- /evaluation/configs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/configs.py -------------------------------------------------------------------------------- /evaluation/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/dataset.py -------------------------------------------------------------------------------- /evaluation/metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/metrics.py -------------------------------------------------------------------------------- /evaluation/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/model.py -------------------------------------------------------------------------------- /evaluation/tasks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/tasks.py -------------------------------------------------------------------------------- /evaluation/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/evaluation/utils.py -------------------------------------------------------------------------------- /generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/generate.py -------------------------------------------------------------------------------- /generation/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/generation/__init__.py -------------------------------------------------------------------------------- /generation/strategies.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/generation/strategies.py -------------------------------------------------------------------------------- /initialize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/initialize.py -------------------------------------------------------------------------------- /kernels/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/kernels/__init__.py -------------------------------------------------------------------------------- /kernels/quantization.fatbin: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/kernels/quantization.fatbin -------------------------------------------------------------------------------- /logs/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/logs/README.md -------------------------------------------------------------------------------- /logs/main-log-en.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/logs/main-log-en.md -------------------------------------------------------------------------------- /logs/main-log.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/logs/main-log.md -------------------------------------------------------------------------------- /quantization/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/quantization/__init__.py -------------------------------------------------------------------------------- /quantization/functional.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/quantization/functional.py -------------------------------------------------------------------------------- /quantization/layers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/quantization/layers.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/requirements.txt -------------------------------------------------------------------------------- /resources/03DF31017FE184DB45D41DFFC6F80EF0.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/03DF31017FE184DB45D41DFFC6F80EF0.png -------------------------------------------------------------------------------- /resources/33872E48D3539EA132B74BCF5EFF458F.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/33872E48D3539EA132B74BCF5EFF458F.png -------------------------------------------------------------------------------- /resources/49BF334CB352BAA19F7D55460B1DBCA9.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/49BF334CB352BAA19F7D55460B1DBCA9.gif -------------------------------------------------------------------------------- /resources/7CB441707D1035B2890AA2164C5B6EAC.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/7CB441707D1035B2890AA2164C5B6EAC.png -------------------------------------------------------------------------------- /resources/7D6433A42D189E2E6FBC62BE066BCE91.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/7D6433A42D189E2E6FBC62BE066BCE91.png -------------------------------------------------------------------------------- /resources/849024E93FA85347F7F6443932911922.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/849024E93FA85347F7F6443932911922.png -------------------------------------------------------------------------------- /resources/AE18F14396E2D22BC0BC8DD77EFD3414.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/AE18F14396E2D22BC0BC8DD77EFD3414.png -------------------------------------------------------------------------------- /resources/E42321373D22DE198231279B5856BB42.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/E42321373D22DE198231279B5856BB42.png -------------------------------------------------------------------------------- /resources/F48B69263360688CCA21E915F4B1A98B.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/F48B69263360688CCA21E915F4B1A98B.png -------------------------------------------------------------------------------- /resources/WECHAT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/WECHAT.md -------------------------------------------------------------------------------- /resources/multitask_list.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/multitask_list.txt -------------------------------------------------------------------------------- /resources/wechat.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/resources/wechat.jpg -------------------------------------------------------------------------------- /scripts/benchmark.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/scripts/benchmark.sh -------------------------------------------------------------------------------- /scripts/evaluate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/scripts/evaluate.sh -------------------------------------------------------------------------------- /scripts/evaluate_multiple_node.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/scripts/evaluate_multiple_node.sh -------------------------------------------------------------------------------- /scripts/generate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/scripts/generate.sh -------------------------------------------------------------------------------- /tasks/bloom/glue_cola.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/glue_cola.yaml -------------------------------------------------------------------------------- /tasks/bloom/glue_mnli.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/glue_mnli.yaml -------------------------------------------------------------------------------- /tasks/bloom/glue_qnli.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/glue_qnli.yaml -------------------------------------------------------------------------------- /tasks/bloom/glue_wnli.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/glue_wnli.yaml -------------------------------------------------------------------------------- /tasks/bloom/math_qa.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/math_qa.yaml -------------------------------------------------------------------------------- /tasks/bloom/mc_taco.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/mc_taco.yaml -------------------------------------------------------------------------------- /tasks/bloom/openbook_qa.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/openbook_qa.yaml -------------------------------------------------------------------------------- /tasks/bloom/pubmed_qa.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/pubmed_qa.yaml -------------------------------------------------------------------------------- /tasks/bloom/superglue_axb.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/superglue_axb.yaml -------------------------------------------------------------------------------- /tasks/bloom/superglue_axg.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/bloom/superglue_axg.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/afqmc.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/afqmc.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/c3.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/c3.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/cluewsc.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/cluewsc.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/cmnli.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/cmnli.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/cmrc2018.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/cmrc2018.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/csl.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/csl.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/drcd.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/drcd.yaml -------------------------------------------------------------------------------- /tasks/chinese/clue/ocnli.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/clue/ocnli.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/bustm.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/bustm.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/chidf.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/chidf.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/cluewscf.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/cluewscf.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/cslf.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/cslf.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/eprstmt.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/eprstmt.yaml -------------------------------------------------------------------------------- /tasks/chinese/fewclue/ocnlif.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/chinese/fewclue/ocnlif.yaml -------------------------------------------------------------------------------- /tasks/ethnic/crows-pair/crows-pair.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/crows-pair/crows-pair.yaml -------------------------------------------------------------------------------- /tasks/ethnic/crows-pair/tasks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/crows-pair/tasks.py -------------------------------------------------------------------------------- /tasks/ethnic/ethos/ethos-fewshot-multi.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/ethos/ethos-fewshot-multi.yaml -------------------------------------------------------------------------------- /tasks/ethnic/ethos/ethos-fewshot-single.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/ethos/ethos-fewshot-single.yaml -------------------------------------------------------------------------------- /tasks/ethnic/ethos/ethos-oneshot.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/ethos/ethos-oneshot.yaml -------------------------------------------------------------------------------- /tasks/ethnic/ethos/ethos-zeroshot.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/ethos/ethos-zeroshot.yaml -------------------------------------------------------------------------------- /tasks/ethnic/stereoset/stereoset.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/stereoset/stereoset.yaml -------------------------------------------------------------------------------- /tasks/ethnic/stereoset/tasks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/ethnic/stereoset/tasks.py -------------------------------------------------------------------------------- /tasks/lambada/lambada-unidirectional.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/lambada/lambada-unidirectional.yaml -------------------------------------------------------------------------------- /tasks/lambada/lambada.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/lambada/lambada.yaml -------------------------------------------------------------------------------- /tasks/lambada/strategy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/lambada/strategy.py -------------------------------------------------------------------------------- /tasks/lambada/task.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/lambada/task.py -------------------------------------------------------------------------------- /tasks/language-modeling/pile.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/language-modeling/pile.py -------------------------------------------------------------------------------- /tasks/language-modeling/pile.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/language-modeling/pile.yaml -------------------------------------------------------------------------------- /tasks/language-modeling/ptb.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/language-modeling/ptb.yaml -------------------------------------------------------------------------------- /tasks/language-modeling/wikitext-103.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/language-modeling/wikitext-103.yaml -------------------------------------------------------------------------------- /tasks/language-modeling/wikitext-2.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/language-modeling/wikitext-2.yaml -------------------------------------------------------------------------------- /tasks/mmlu/mmlu.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/mmlu/mmlu.yaml -------------------------------------------------------------------------------- /tasks/mmlu/task.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tasks/mmlu/task.py -------------------------------------------------------------------------------- /tools/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tools/convert_tp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tools/convert_tp.py -------------------------------------------------------------------------------- /tools/tokenize_pile.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zai-org/GLM-130B/HEAD/tools/tokenize_pile.py --------------------------------------------------------------------------------