├── .gitignore ├── Presentation ├── TSS_#0_Template.pdf ├── TSS_#0_intro.pdf ├── TSS_#1_Transformer_Basic.pdf ├── TSS_#2_Sparse_Attention.pdf ├── TSS_#3_Linearized_Attention_Prototype_and_Memory_Compression.pdf ├── TSS_#4_Lowrank_Prior_Improved_Attention.pdf ├── TSS_#5_Module_Level_Variants.pdf ├── TTS_#6_Architecture_Level_Variants.pdf └── TTS_Appendix_Complexity_Parameters_Scaling.pdf ├── README.md └── img ├── hs.jpeg ├── jh.png ├── jina.jpeg ├── ms.jpeg ├── paper_all.png ├── sb.png ├── tss_main.png └── yk.jpg /.gitignore: -------------------------------------------------------------------------------- 1 | *.DS_Store 2 | 3 | -------------------------------------------------------------------------------- /Presentation/TSS_#0_Template.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#0_Template.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#0_intro.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#0_intro.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#1_Transformer_Basic.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#1_Transformer_Basic.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#2_Sparse_Attention.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#2_Sparse_Attention.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#3_Linearized_Attention_Prototype_and_Memory_Compression.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#3_Linearized_Attention_Prototype_and_Memory_Compression.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#4_Lowrank_Prior_Improved_Attention.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#4_Lowrank_Prior_Improved_Attention.pdf -------------------------------------------------------------------------------- /Presentation/TSS_#5_Module_Level_Variants.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TSS_#5_Module_Level_Variants.pdf -------------------------------------------------------------------------------- /Presentation/TTS_#6_Architecture_Level_Variants.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TTS_#6_Architecture_Level_Variants.pdf -------------------------------------------------------------------------------- /Presentation/TTS_Appendix_Complexity_Parameters_Scaling.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/Presentation/TTS_Appendix_Complexity_Parameters_Scaling.pdf -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/README.md -------------------------------------------------------------------------------- /img/hs.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/hs.jpeg -------------------------------------------------------------------------------- /img/jh.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/jh.png -------------------------------------------------------------------------------- /img/jina.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/jina.jpeg -------------------------------------------------------------------------------- /img/ms.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/ms.jpeg -------------------------------------------------------------------------------- /img/paper_all.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/paper_all.png -------------------------------------------------------------------------------- /img/sb.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/sb.png -------------------------------------------------------------------------------- /img/tss_main.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/tss_main.png -------------------------------------------------------------------------------- /img/yk.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yukyunglee/Transformer_Survey_Study/HEAD/img/yk.jpg --------------------------------------------------------------------------------