├── .gitmodules ├── LICENSE ├── README.md ├── download_index_db.py ├── index-server ├── README.md ├── api.py ├── build_db.py ├── build_index.py ├── build_shard.py ├── build_split_meta.py └── config_IVF1024PQ48.json ├── requirement.txt └── train ├── config.json ├── data ├── test_data.json └── train_data.json ├── dataset.py ├── generate.py ├── inference.py ├── prepare_load.py └── train.py /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/.gitmodules -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/README.md -------------------------------------------------------------------------------- /download_index_db.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/download_index_db.py -------------------------------------------------------------------------------- /index-server/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/README.md -------------------------------------------------------------------------------- /index-server/api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/api.py -------------------------------------------------------------------------------- /index-server/build_db.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/build_db.py -------------------------------------------------------------------------------- /index-server/build_index.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/build_index.py -------------------------------------------------------------------------------- /index-server/build_shard.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/build_shard.py -------------------------------------------------------------------------------- /index-server/build_split_meta.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/build_split_meta.py -------------------------------------------------------------------------------- /index-server/config_IVF1024PQ48.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/index-server/config_IVF1024PQ48.json -------------------------------------------------------------------------------- /requirement.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/requirement.txt -------------------------------------------------------------------------------- /train/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/config.json -------------------------------------------------------------------------------- /train/data/test_data.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/data/test_data.json -------------------------------------------------------------------------------- /train/data/train_data.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/data/train_data.json -------------------------------------------------------------------------------- /train/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/dataset.py -------------------------------------------------------------------------------- /train/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/generate.py -------------------------------------------------------------------------------- /train/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/inference.py -------------------------------------------------------------------------------- /train/prepare_load.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/prepare_load.py -------------------------------------------------------------------------------- /train/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Langboat/mengzi-retrieval-lm/HEAD/train/train.py --------------------------------------------------------------------------------