├── .gitignore ├── README.md ├── evaluator.py ├── evaluator_qg.py ├── fix_question.py ├── model ├── decision.py ├── span.py └── transformer.py ├── preprocess_decision.py ├── preprocess_span.py ├── qg.py ├── segedu ├── all_vocabulary.pickle ├── model.py ├── preprocess_discourse_segment.py ├── readme.txt ├── requirements.txt ├── sharc_discourse_segmentation.py ├── solver.py └── trained_model.torchsave ├── train_sharc.py └── unilmqg ├── __init__.py ├── biunilm ├── __init__.py ├── decode_seq2seq.py ├── evaluator.py ├── gen_seq_from_trace.py ├── loader_utils.py ├── run_seq2seq.py └── seq2seq_loader.py ├── nn ├── __init__.py └── data_parallel.py ├── pytorch_pretrained_bert ├── __init__.py ├── __main__.py ├── file_utils.py ├── loss.py ├── modeling.py ├── optimization.py ├── optimization_fp16.py └── tokenization.py └── setup.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/README.md -------------------------------------------------------------------------------- /evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/evaluator.py -------------------------------------------------------------------------------- /evaluator_qg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/evaluator_qg.py -------------------------------------------------------------------------------- /fix_question.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/fix_question.py -------------------------------------------------------------------------------- /model/decision.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/model/decision.py -------------------------------------------------------------------------------- /model/span.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/model/span.py -------------------------------------------------------------------------------- /model/transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/model/transformer.py -------------------------------------------------------------------------------- /preprocess_decision.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/preprocess_decision.py -------------------------------------------------------------------------------- /preprocess_span.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/preprocess_span.py -------------------------------------------------------------------------------- /qg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/qg.py -------------------------------------------------------------------------------- /segedu/all_vocabulary.pickle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/all_vocabulary.pickle -------------------------------------------------------------------------------- /segedu/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/model.py -------------------------------------------------------------------------------- /segedu/preprocess_discourse_segment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/preprocess_discourse_segment.py -------------------------------------------------------------------------------- /segedu/readme.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/readme.txt -------------------------------------------------------------------------------- /segedu/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/requirements.txt -------------------------------------------------------------------------------- /segedu/sharc_discourse_segmentation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/sharc_discourse_segmentation.py -------------------------------------------------------------------------------- /segedu/solver.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/solver.py -------------------------------------------------------------------------------- /segedu/trained_model.torchsave: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/segedu/trained_model.torchsave -------------------------------------------------------------------------------- /train_sharc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/train_sharc.py -------------------------------------------------------------------------------- /unilmqg/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /unilmqg/biunilm/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /unilmqg/biunilm/decode_seq2seq.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/decode_seq2seq.py -------------------------------------------------------------------------------- /unilmqg/biunilm/evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/evaluator.py -------------------------------------------------------------------------------- /unilmqg/biunilm/gen_seq_from_trace.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/gen_seq_from_trace.py -------------------------------------------------------------------------------- /unilmqg/biunilm/loader_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/loader_utils.py -------------------------------------------------------------------------------- /unilmqg/biunilm/run_seq2seq.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/run_seq2seq.py -------------------------------------------------------------------------------- /unilmqg/biunilm/seq2seq_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/biunilm/seq2seq_loader.py -------------------------------------------------------------------------------- /unilmqg/nn/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /unilmqg/nn/data_parallel.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/nn/data_parallel.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/__init__.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/__main__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/__main__.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/file_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/file_utils.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/loss.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/modeling.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/optimization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/optimization.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/optimization_fp16.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/optimization_fp16.py -------------------------------------------------------------------------------- /unilmqg/pytorch_pretrained_bert/tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/pytorch_pretrained_bert/tokenization.py -------------------------------------------------------------------------------- /unilmqg/setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yifan-Gao/Discern/HEAD/unilmqg/setup.py --------------------------------------------------------------------------------