├── .github ├── ISSUE_TEMPLATE │ ├── bug_report.md │ └── feature_request.md └── workflows │ └── pytest.yml ├── .gitignore ├── CITATION.bib ├── CODEOWNERS ├── Dockerfile ├── GPTNeo_example_notebook.ipynb ├── LICENSE ├── README.md ├── configs.py ├── configs ├── dataset_configs │ ├── example.json │ ├── openwebtext2_new_inputs.json │ └── pile.json ├── gpt2_small.json ├── gpt3_13B_256.json ├── gpt3_13B_256_Pile.json ├── gpt3_2-7B_256.json ├── gpt3_6-7B_256.json ├── gpt3_PAR_small_256.json ├── gpt3_XL_256_Pile.json ├── gpt3_large_256.json ├── gpt3_medium_256.json └── gpt3_small_256.json ├── data ├── create_tfrecords.py ├── encoders.py └── train_tokenizer.py ├── docker-compose.yml ├── encoders.py ├── export.py ├── inputs.py ├── main.py ├── model_fns.py ├── models ├── activations.py ├── gpt2 │ └── gpt2.py ├── layers.py └── utils.py ├── optimizers.py ├── requirements.txt ├── run_experiment.py ├── sample.py ├── tasks.py ├── test_models.py └── utils.py /.github/ISSUE_TEMPLATE/bug_report.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/.github/ISSUE_TEMPLATE/bug_report.md -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/feature_request.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/.github/ISSUE_TEMPLATE/feature_request.md -------------------------------------------------------------------------------- /.github/workflows/pytest.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/.github/workflows/pytest.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/.gitignore -------------------------------------------------------------------------------- /CITATION.bib: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/CITATION.bib -------------------------------------------------------------------------------- /CODEOWNERS: -------------------------------------------------------------------------------- 1 | * EleutherAI/pm-gptneo 2 | -------------------------------------------------------------------------------- /Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/Dockerfile -------------------------------------------------------------------------------- /GPTNeo_example_notebook.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/GPTNeo_example_notebook.ipynb -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/README.md -------------------------------------------------------------------------------- /configs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs.py -------------------------------------------------------------------------------- /configs/dataset_configs/example.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/dataset_configs/example.json -------------------------------------------------------------------------------- /configs/dataset_configs/openwebtext2_new_inputs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/dataset_configs/openwebtext2_new_inputs.json -------------------------------------------------------------------------------- /configs/dataset_configs/pile.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/dataset_configs/pile.json -------------------------------------------------------------------------------- /configs/gpt2_small.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt2_small.json -------------------------------------------------------------------------------- /configs/gpt3_13B_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_13B_256.json -------------------------------------------------------------------------------- /configs/gpt3_13B_256_Pile.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_13B_256_Pile.json -------------------------------------------------------------------------------- /configs/gpt3_2-7B_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_2-7B_256.json -------------------------------------------------------------------------------- /configs/gpt3_6-7B_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_6-7B_256.json -------------------------------------------------------------------------------- /configs/gpt3_PAR_small_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_PAR_small_256.json -------------------------------------------------------------------------------- /configs/gpt3_XL_256_Pile.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_XL_256_Pile.json -------------------------------------------------------------------------------- /configs/gpt3_large_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_large_256.json -------------------------------------------------------------------------------- /configs/gpt3_medium_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_medium_256.json -------------------------------------------------------------------------------- /configs/gpt3_small_256.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/configs/gpt3_small_256.json -------------------------------------------------------------------------------- /data/create_tfrecords.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/data/create_tfrecords.py -------------------------------------------------------------------------------- /data/encoders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/data/encoders.py -------------------------------------------------------------------------------- /data/train_tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/data/train_tokenizer.py -------------------------------------------------------------------------------- /docker-compose.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/docker-compose.yml -------------------------------------------------------------------------------- /encoders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/encoders.py -------------------------------------------------------------------------------- /export.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/export.py -------------------------------------------------------------------------------- /inputs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/inputs.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/main.py -------------------------------------------------------------------------------- /model_fns.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/model_fns.py -------------------------------------------------------------------------------- /models/activations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/models/activations.py -------------------------------------------------------------------------------- /models/gpt2/gpt2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/models/gpt2/gpt2.py -------------------------------------------------------------------------------- /models/layers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/models/layers.py -------------------------------------------------------------------------------- /models/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/models/utils.py -------------------------------------------------------------------------------- /optimizers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/optimizers.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/requirements.txt -------------------------------------------------------------------------------- /run_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/run_experiment.py -------------------------------------------------------------------------------- /sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/sample.py -------------------------------------------------------------------------------- /tasks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/tasks.py -------------------------------------------------------------------------------- /test_models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/test_models.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/gpt-neo/HEAD/utils.py --------------------------------------------------------------------------------