├── License ├── README.md ├── assets ├── cn_stat.png ├── domain.png ├── en_stat.png ├── examples.png ├── length.png └── pipeline.png ├── coherence ├── get_en_coherence.py └── get_zh_coherence.py ├── cohesion ├── dmr │ ├── README.md │ ├── dmv_inference.py │ ├── dmv_train.py │ ├── get_data.py │ ├── get_dmv_score.py │ ├── merge_data.py │ ├── model.py │ └── utils.py └── get_pron_conn_score.py └── complexity ├── get_en_complexity.py └── get_zh_complexity.py /License: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/License -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/README.md -------------------------------------------------------------------------------- /assets/cn_stat.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/cn_stat.png -------------------------------------------------------------------------------- /assets/domain.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/domain.png -------------------------------------------------------------------------------- /assets/en_stat.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/en_stat.png -------------------------------------------------------------------------------- /assets/examples.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/examples.png -------------------------------------------------------------------------------- /assets/length.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/length.png -------------------------------------------------------------------------------- /assets/pipeline.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/assets/pipeline.png -------------------------------------------------------------------------------- /coherence/get_en_coherence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/coherence/get_en_coherence.py -------------------------------------------------------------------------------- /coherence/get_zh_coherence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/coherence/get_zh_coherence.py -------------------------------------------------------------------------------- /cohesion/dmr/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/README.md -------------------------------------------------------------------------------- /cohesion/dmr/dmv_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/dmv_inference.py -------------------------------------------------------------------------------- /cohesion/dmr/dmv_train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/dmv_train.py -------------------------------------------------------------------------------- /cohesion/dmr/get_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/get_data.py -------------------------------------------------------------------------------- /cohesion/dmr/get_dmv_score.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/get_dmv_score.py -------------------------------------------------------------------------------- /cohesion/dmr/merge_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/merge_data.py -------------------------------------------------------------------------------- /cohesion/dmr/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/model.py -------------------------------------------------------------------------------- /cohesion/dmr/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/dmr/utils.py -------------------------------------------------------------------------------- /cohesion/get_pron_conn_score.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/cohesion/get_pron_conn_score.py -------------------------------------------------------------------------------- /complexity/get_en_complexity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/complexity/get_en_complexity.py -------------------------------------------------------------------------------- /complexity/get_zh_complexity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenLMLab/LongWanjuan/HEAD/complexity/get_zh_complexity.py --------------------------------------------------------------------------------