├── .gitignore ├── LICENSE ├── ReadMe.md ├── components ├── attention.py ├── k_lstm.py ├── linear_scheduler.py ├── rnn.py └── rnn_base.py ├── configs ├── config_d2.yaml ├── config_d3.yaml ├── embed_vocab.yaml ├── segment_test.yaml └── segment_train_val.yaml ├── data_utils.py ├── dataloader.py ├── dataset └── helpers │ ├── .DS_Store │ └── constants │ ├── ARABIC_LETTERS_LIST.pickle │ ├── CLASSES_LIST.pickle │ └── DIACRITICS_LIST.pickle ├── model_d2.py ├── model_d3.py ├── predict_d2.py ├── predict_d3.py ├── requirements.txt ├── scripts ├── download_fasttext_ar.sh ├── download_tashkeela.sh ├── embed_vocab.sh ├── evaluate.sh ├── segment_test.sh ├── segment_train_val.sh └── train.sh ├── train_d2.py ├── train_d3.py └── utils ├── embed_vocab.py ├── evaluator.py ├── get_vocab.py └── segment.py /.gitignore: -------------------------------------------------------------------------------- 1 | dataset/tashkeela 2 | models 3 | logs 4 | 5 | *.pyc -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/LICENSE -------------------------------------------------------------------------------- /ReadMe.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/ReadMe.md -------------------------------------------------------------------------------- /components/attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/components/attention.py -------------------------------------------------------------------------------- /components/k_lstm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/components/k_lstm.py -------------------------------------------------------------------------------- /components/linear_scheduler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/components/linear_scheduler.py -------------------------------------------------------------------------------- /components/rnn.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /components/rnn_base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/components/rnn_base.py -------------------------------------------------------------------------------- /configs/config_d2.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/configs/config_d2.yaml -------------------------------------------------------------------------------- /configs/config_d3.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/configs/config_d3.yaml -------------------------------------------------------------------------------- /configs/embed_vocab.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/configs/embed_vocab.yaml -------------------------------------------------------------------------------- /configs/segment_test.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/configs/segment_test.yaml -------------------------------------------------------------------------------- /configs/segment_train_val.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/configs/segment_train_val.yaml -------------------------------------------------------------------------------- /data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/data_utils.py -------------------------------------------------------------------------------- /dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/dataloader.py -------------------------------------------------------------------------------- /dataset/helpers/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/dataset/helpers/.DS_Store -------------------------------------------------------------------------------- /dataset/helpers/constants/ARABIC_LETTERS_LIST.pickle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/dataset/helpers/constants/ARABIC_LETTERS_LIST.pickle -------------------------------------------------------------------------------- /dataset/helpers/constants/CLASSES_LIST.pickle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/dataset/helpers/constants/CLASSES_LIST.pickle -------------------------------------------------------------------------------- /dataset/helpers/constants/DIACRITICS_LIST.pickle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/dataset/helpers/constants/DIACRITICS_LIST.pickle -------------------------------------------------------------------------------- /model_d2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/model_d2.py -------------------------------------------------------------------------------- /model_d3.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/model_d3.py -------------------------------------------------------------------------------- /predict_d2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/predict_d2.py -------------------------------------------------------------------------------- /predict_d3.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/predict_d3.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/download_fasttext_ar.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/download_fasttext_ar.sh -------------------------------------------------------------------------------- /scripts/download_tashkeela.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/download_tashkeela.sh -------------------------------------------------------------------------------- /scripts/embed_vocab.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/embed_vocab.sh -------------------------------------------------------------------------------- /scripts/evaluate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/evaluate.sh -------------------------------------------------------------------------------- /scripts/segment_test.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/segment_test.sh -------------------------------------------------------------------------------- /scripts/segment_train_val.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/segment_train_val.sh -------------------------------------------------------------------------------- /scripts/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/scripts/train.sh -------------------------------------------------------------------------------- /train_d2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/train_d2.py -------------------------------------------------------------------------------- /train_d3.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/train_d3.py -------------------------------------------------------------------------------- /utils/embed_vocab.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/utils/embed_vocab.py -------------------------------------------------------------------------------- /utils/evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/utils/evaluator.py -------------------------------------------------------------------------------- /utils/get_vocab.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/utils/get_vocab.py -------------------------------------------------------------------------------- /utils/segment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/BKHMSI/deep-diacritization/HEAD/utils/segment.py --------------------------------------------------------------------------------