├── LICENSE ├── README.md ├── __init__.py ├── assets ├── 111m.png ├── 13b.png ├── 70b.png └── boats.png ├── configs ├── 111m.yaml ├── 13b.yaml ├── 175b.yaml ├── 1p3b.yaml └── 70b.yaml ├── configuration.py ├── data.py ├── data ├── openwebtext │ ├── prepare.py │ └── readme.md ├── shakespeare │ ├── prepare.py │ └── readme.md └── shakespeare_char │ ├── prepare.py │ └── readme.md ├── eval.py ├── model.py ├── requirements.txt ├── sample.py └── train.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/README.md -------------------------------------------------------------------------------- /__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /assets/111m.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/assets/111m.png -------------------------------------------------------------------------------- /assets/13b.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/assets/13b.png -------------------------------------------------------------------------------- /assets/70b.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/assets/70b.png -------------------------------------------------------------------------------- /assets/boats.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/assets/boats.png -------------------------------------------------------------------------------- /configs/111m.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configs/111m.yaml -------------------------------------------------------------------------------- /configs/13b.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configs/13b.yaml -------------------------------------------------------------------------------- /configs/175b.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configs/175b.yaml -------------------------------------------------------------------------------- /configs/1p3b.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configs/1p3b.yaml -------------------------------------------------------------------------------- /configs/70b.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configs/70b.yaml -------------------------------------------------------------------------------- /configuration.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/configuration.py -------------------------------------------------------------------------------- /data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data.py -------------------------------------------------------------------------------- /data/openwebtext/prepare.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/openwebtext/prepare.py -------------------------------------------------------------------------------- /data/openwebtext/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/openwebtext/readme.md -------------------------------------------------------------------------------- /data/shakespeare/prepare.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/shakespeare/prepare.py -------------------------------------------------------------------------------- /data/shakespeare/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/shakespeare/readme.md -------------------------------------------------------------------------------- /data/shakespeare_char/prepare.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/shakespeare_char/prepare.py -------------------------------------------------------------------------------- /data/shakespeare_char/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/data/shakespeare_char/readme.md -------------------------------------------------------------------------------- /eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/eval.py -------------------------------------------------------------------------------- /model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/model.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/requirements.txt -------------------------------------------------------------------------------- /sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/sample.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Cerebras/gigaGPT/HEAD/train.py --------------------------------------------------------------------------------