├── .gitignore ├── 1_counting-letters ├── README.md ├── images │ ├── attention.png │ └── task_1.png └── main.py ├── 2_difference ├── README.md ├── images │ ├── enc_attention_noself.png │ ├── enc_attention_self.png │ └── self_attention_self.png └── main.py ├── 3_signal ├── README.md ├── images │ ├── attention.png │ └── positional_encodings.png └── main.py ├── 4_signal2 ├── README.md └── main.py ├── 5_translation ├── README.md ├── data │ ├── de_dict.json │ ├── en_dict.json │ ├── train.tags.de-en.de │ └── train.tags.de-en.en ├── images │ ├── line_10.png │ ├── line_153.png │ ├── line_39.png │ ├── line_4.png │ └── line_86.png ├── main.py ├── make_dict.py └── models │ ├── checkpoint │ ├── ckpt-50000.data-00000-of-00001 │ ├── ckpt-50000.index │ └── ckpt-50000.meta └── README.md /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/.gitignore -------------------------------------------------------------------------------- /1_counting-letters/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/1_counting-letters/README.md -------------------------------------------------------------------------------- /1_counting-letters/images/attention.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/1_counting-letters/images/attention.png -------------------------------------------------------------------------------- /1_counting-letters/images/task_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/1_counting-letters/images/task_1.png -------------------------------------------------------------------------------- /1_counting-letters/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/1_counting-letters/main.py -------------------------------------------------------------------------------- /2_difference/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/2_difference/README.md -------------------------------------------------------------------------------- /2_difference/images/enc_attention_noself.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/2_difference/images/enc_attention_noself.png -------------------------------------------------------------------------------- /2_difference/images/enc_attention_self.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/2_difference/images/enc_attention_self.png -------------------------------------------------------------------------------- /2_difference/images/self_attention_self.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/2_difference/images/self_attention_self.png -------------------------------------------------------------------------------- /2_difference/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/2_difference/main.py -------------------------------------------------------------------------------- /3_signal/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/3_signal/README.md -------------------------------------------------------------------------------- /3_signal/images/attention.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/3_signal/images/attention.png -------------------------------------------------------------------------------- /3_signal/images/positional_encodings.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/3_signal/images/positional_encodings.png -------------------------------------------------------------------------------- /3_signal/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/3_signal/main.py -------------------------------------------------------------------------------- /4_signal2/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/4_signal2/README.md -------------------------------------------------------------------------------- /4_signal2/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/4_signal2/main.py -------------------------------------------------------------------------------- /5_translation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/README.md -------------------------------------------------------------------------------- /5_translation/data/de_dict.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/data/de_dict.json -------------------------------------------------------------------------------- /5_translation/data/en_dict.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/data/en_dict.json -------------------------------------------------------------------------------- /5_translation/data/train.tags.de-en.de: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/data/train.tags.de-en.de -------------------------------------------------------------------------------- /5_translation/data/train.tags.de-en.en: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/data/train.tags.de-en.en -------------------------------------------------------------------------------- /5_translation/images/line_10.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/images/line_10.png -------------------------------------------------------------------------------- /5_translation/images/line_153.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/images/line_153.png -------------------------------------------------------------------------------- /5_translation/images/line_39.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/images/line_39.png -------------------------------------------------------------------------------- /5_translation/images/line_4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/images/line_4.png -------------------------------------------------------------------------------- /5_translation/images/line_86.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/images/line_86.png -------------------------------------------------------------------------------- /5_translation/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/main.py -------------------------------------------------------------------------------- /5_translation/make_dict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/make_dict.py -------------------------------------------------------------------------------- /5_translation/models/checkpoint: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/models/checkpoint -------------------------------------------------------------------------------- /5_translation/models/ckpt-50000.data-00000-of-00001: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/models/ckpt-50000.data-00000-of-00001 -------------------------------------------------------------------------------- /5_translation/models/ckpt-50000.index: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/models/ckpt-50000.index -------------------------------------------------------------------------------- /5_translation/models/ckpt-50000.meta: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/5_translation/models/ckpt-50000.meta -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/greentfrapp/attention-primer/HEAD/README.md --------------------------------------------------------------------------------