├── README.md ├── common ├── arg.py ├── dataset.py ├── generate.py ├── line_graph.py └── preprocess.py ├── config ├── meena-config-small.json ├── meena-config.json ├── meena-finetuning-config-v3.json └── meena-finetuning-config.json ├── data ├── conversation_data │ ├── __init__.py │ ├── origin │ │ └── __init__.py │ └── processed │ │ └── __init__.py ├── sample_data.txt ├── sample_messanger.txt └── vocab-10K.txt ├── example ├── chat.py ├── model_summary.py └── streamlit_chat.py ├── images ├── meena_architecture.png └── meena_pretrain_losses.png ├── logs └── eval_log.txt ├── model ├── meena.py ├── transformer.py └── util.py ├── requirements.txt └── train ├── run_finetuning.py └── run_pretraining.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/README.md -------------------------------------------------------------------------------- /common/arg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/common/arg.py -------------------------------------------------------------------------------- /common/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/common/dataset.py -------------------------------------------------------------------------------- /common/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/common/generate.py -------------------------------------------------------------------------------- /common/line_graph.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/common/line_graph.py -------------------------------------------------------------------------------- /common/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/common/preprocess.py -------------------------------------------------------------------------------- /config/meena-config-small.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/config/meena-config-small.json -------------------------------------------------------------------------------- /config/meena-config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/config/meena-config.json -------------------------------------------------------------------------------- /config/meena-finetuning-config-v3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/config/meena-finetuning-config-v3.json -------------------------------------------------------------------------------- /config/meena-finetuning-config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/config/meena-finetuning-config.json -------------------------------------------------------------------------------- /data/conversation_data/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/conversation_data/origin/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/conversation_data/processed/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/sample_data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/data/sample_data.txt -------------------------------------------------------------------------------- /data/sample_messanger.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/data/sample_messanger.txt -------------------------------------------------------------------------------- /data/vocab-10K.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/data/vocab-10K.txt -------------------------------------------------------------------------------- /example/chat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/example/chat.py -------------------------------------------------------------------------------- /example/model_summary.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/example/model_summary.py -------------------------------------------------------------------------------- /example/streamlit_chat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/example/streamlit_chat.py -------------------------------------------------------------------------------- /images/meena_architecture.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/images/meena_architecture.png -------------------------------------------------------------------------------- /images/meena_pretrain_losses.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/images/meena_pretrain_losses.png -------------------------------------------------------------------------------- /logs/eval_log.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/logs/eval_log.txt -------------------------------------------------------------------------------- /model/meena.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/model/meena.py -------------------------------------------------------------------------------- /model/transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/model/transformer.py -------------------------------------------------------------------------------- /model/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/model/util.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/requirements.txt -------------------------------------------------------------------------------- /train/run_finetuning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/train/run_finetuning.py -------------------------------------------------------------------------------- /train/run_pretraining.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nawnoes/pytorch-meena/HEAD/train/run_pretraining.py --------------------------------------------------------------------------------