├── README.md └── diagram.png /README.md: -------------------------------------------------------------------------------- 1 | # Awesome Capsule Networks [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome) 2 | 3 | 4 | 5 | A curated list of awesome resources related to capsule networks maintained by [AI Summary](http://aisummary.com). 6 | 7 | ## Contributing 8 | Please [pull a request](https://github.com/aisummary/awesome-capsule-networks/pulls) if you are aware of additional resources. 9 | 10 | Your feedback and contributions are always welcome! 11 | 12 | ## Sharing 13 | - [Share on Twitter](http://twitter.com/home?status=http://github.com/sekwiatkowski/awesome-capsule-networks) 14 | - [Share on Facebook](http://www.facebook.com/sharer/sharer.php?u=http://github.com/sekwiatkowski/awesome-capsule-networks) 15 | - [Share on Google Plus](http://plus.google.com/share?url=http://github.com/sekwiatkowski/awesome-capsule-networks) 16 | - [Share on LinkedIn](http://www.linkedin.com/shareArticle?mini=true&url=http://github.com/sekwiatkowski/awesome-capsule-networks) 17 | 18 | ## Table of Contents 19 | - [Papers](#papers) 20 | - [Papers by Geoffrey Hinton and colleagues](#papers-by-hinton-et-al) 21 | - [Under review](#under-review) 22 | - [Preprints](#preprints) 23 | - [Videos](#videos) 24 | - [Blogs](#blogs) 25 | - [Dynamic routing implementations](#dynamic-routing-implementations) 26 | - [Official implementation](#official-implementation) 27 | - [Chainer](#chainer) 28 | - [CNTK](#cntk) 29 | - [Keras](#keras) 30 | - [Matlab](#matlab) 31 | - [MXNet](#mxnet) 32 | - [PyTorch](#pytorch) 33 | - [R](#r) 34 | - [TensorFlow](#tensorflow) 35 | - [Torch](#torch) 36 | - [EM routing implementations](#em-routing-implementations) 37 | - [PyTorch](#em-routing-pytorch) 38 | - [TensorFlow](#em-routing-tensorflow) 39 | - [Other resources](#other-resources) 40 | - [License](#license) 41 | 42 | ## Papers 43 | 44 | ### Papers by Hinton et al. 45 | - [Matrix capsules with EM routing](https://openreview.net/forum?id=HJWLfGWRb) - Hinton, G. E., Sabour, S. and Frosst, N. (2018) 46 | - [Dynamic Routing Between Capsules](https://arxiv.org/abs/1710.09829) - Sabour, S., Frosst, N. and Hinton, G.E. (2017) 47 | - [Transforming Auto-encoders](http://www.cs.toronto.edu/~fritz/absps/transauto6.pdf) - Hinton, G. E., Krizhevsky, A. and Wang, S. D. (2011) 48 | - [A parallel computation that assigns canonical object-based frames of reference.](http://www.cs.toronto.edu/~fritz/absps/object-based81.pdf) - Hinton, G.E. (1981) 49 | - [Shape representation in parallel systems](http://www.cs.toronto.edu/~fritz/absps/shape81.pdf) - Hinton, G.E. (1981) 50 | - [Optimizing Neural Networks that Generate Images](http://www.cs.toronto.edu/~tijmen/tijmen_thesis.pdf) - Tijmen Tieleman's disseration 51 | 52 | ### Other papers 53 | - [Multi-level Dense Capsule Networks](https://github.com/ssrp/Multi-level-DCNet) - S. S. R. Phaye, A. Sikka, A. Dhall and D. R. Bathula (2018) 54 | 55 | ### Under review 56 | - [An Optimization View on Dynamic Routing Between Capsules](https://openreview.net/forum?id=HJjtFYJDf) - Wang, D., Liu, E. (2018) 57 | - [Spectral Capsule Networks](https://openreview.net/forum?id=ByVJlqR8G) - Bahadori, M. T. (2018) 58 | 59 | ### Preprints 60 | - [Capsule Network Performance on Complex Data](https://arxiv.org/pdf/1712.03480.pdf) - Xi, E., Bing, S. and Jin, Y. (2017) 61 | - [Accurate reconstruction of image stimuli from human fMRI based on the decoding model with capsule network architecture](https://arxiv.org/ftp/arxiv/papers/1801/1801.00602.pdf) - Qiao, K., Zhang, C., Wang, L., Yan, B., Chen, J., Zeng, L. and Tong, L. (2018) 62 | - [CapsuleGAN: Generative Adversarial Capsule Network](https://arxiv.org/pdf/1802.06167.pdf) - Jaiswal, A., AbdAlmageed, W. and Natarajan, P. (2018) 63 | - [Brain Tumor Type Classification via Capsule Networks](https://arxiv.org/pdf/1802.10200.pdf) - Afshar, Parnian., Mohammadi, A., and Plataniotis, K. N. (2018) 64 | - [Sentiment Analysis by Capsules](https://www.researchgate.net/profile/Aixin_Sun/publication/323257127_Sentiment_Analysis_by_Capsules/links/5a8a3be5aca272017e621e81/Sentiment-Analysis-by-Capsules.pdf) - Wang, Y., Sun, A., Han, J., Liu, Y. and Zhu, X. (2018) 65 | - [Capsules for Object Segmentation](https://arxiv.org/pdf/1804.04241.pdf) - LaLonde, R. and Bagci, U. (2018) 66 | - [Sparse Unsupervised Capsules Generalize Better](https://arxiv.org/abs/1804.06094) - Rawlinson, D., Ahmed, A. and Kowadlo, G. (2018) 67 | - [VideoCapsuleNet: A Simplified Network for Action Detection](https://arxiv.org/abs/1805.08162) - Duarte, K., Rawat, Y.S. and Shah, M. (2018) 68 | - [Fast CapsNet for Lung Cancer Screening](https://arxiv.org/abs/1806.07416) - Mobiny, A. and Nguyen, H.V. (2018) 69 | - [Automated Classification of Apoptosis in Phase Contrast Microscopy Using Capsule Network](https://ieeexplore.ieee.org/abstract/document/8720196) - Mobiny, A., Lu H., Nguyen, H.V., Roysam, B. and Varadarajan, N. (2019) [(code)](https://github.com/amobiny/Deep_Capsule_Network) 70 | 71 | ## Videos 72 | - [Geoffrey Hinton's talk: What is wrong with convolutional neural nets?](https://www.youtube.com/watch?v=rTawFwUvnLE) - Talk given at MIT. Brain & Cognitive Sciences - Fall Colloquium Series. 73 | - [Capsule Networks (CapsNets) – Tutorial](https://www.youtube.com/watch?v=pPN8d0E3900) - "This is an amazingly good video. I wish I could explain capsules that well." (Geoffrey Hinton) 74 | - [Capsule networks: overview](https://www.youtube.com/watch?v=YqazfBLLV4U) - Overview of Hinton's capsule networks, including vector and matrix capsules. 75 | - [Overview of awesome videos](http://www.aisummary.com/blog/watch-three-videos-understand-capsule-networks/) 76 | 77 | ## Blogs 78 | - Understanding Hinton’s Capsule Networks - Max Pechyonkin's series 79 | - [Part 1: Intuition](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-i-intuition-b4b559d1159b) 80 | - [Part 2: How Capsules Work](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-ii-how-capsules-work-153b6ade9f66) 81 | - [Part 3: Dynamic Routing Between Capsules](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-iii-dynamic-routing-between-capsules-349f6d30418) 82 | - [Part 4: CapsNet Architecture](https://medium.com/@pechyonkin/part-iv-capsnet-architecture-6a64422f7dce) 83 | - [Uncovering the Intuition behind Capsule Networks and Inverse Graphic](https://hackernoon.com/uncovering-the-intuition-behind-capsule-networks-and-inverse-graphics-part-i-7412d121798d) - Tanay Kothari's long-form tutorial 84 | - [A Visual Representation of Capsule Connections in Dynamic Routing Between Capsules](https://medium.com/@mike_ross/a-visual-representation-of-capsule-network-computations-83767d79e737) - Mike Ross's diagram 85 | - [What is a CapsNet or Capsule Network?](https://hackernoon.com/what-is-a-capsnet-or-capsule-network-2bfbe48769cc) - Debarko De's tutorial with commented code 86 | - [Capsule Networks Are Shaking up AI — Here’s How to Use Them](https://hackernoon.com/capsule-networks-are-shaking-up-ai-heres-how-to-use-them-c233a0971952) - Nick Bourdakos's introduction 87 | - [Understanding Capsule Networks — AI’s Alluring New Architecture](https://medium.freecodecamp.org/understanding-capsule-networks-ais-alluring-new-architecture-bdb228173ddc) - Nick Bourdakos's deeper explanation about capsules with the visualization tool 88 | - [Capsule Networks Explained](https://kndrck.co/posts/capsule_networks_explained/) - Kendrick Tan's explanation 89 | - [Understanding Dynamic Routing between Capsules (Capsule Networks)](https://jhui.github.io/2017/11/03/Dynamic-Routing-Between-Capsules/): Jonathan Hui's tutorial with commented code 90 | - [Matrix capsules with EM routing](https://blog.acolyer.org/2017/11/14/matrix-capsules-with-em-routing/) - Adrian Colyer's post on EM routing 91 | - [Cuda, TensorFlow and Capsule Networks](http://jostosh.github.io/posts/capscuda.html) - Jos van de Wolfshaar's post on custom TensorFlow Ops with CUDA support for the prediction operation 92 | - [Capsule Networks: A Glossary](http://www.aisummary.com/blog/capsule-networks-glossary/) - Sebastian Kwiatkowski's glossary 93 | - [Overview of awesome articles](http://www.aisummary.com/blog/three-complementary-capsule-network-tutorials/) 94 | 95 | ## Dynamic routing implementations 96 | 97 | ### Official implementation 98 | - [Sarasra/models](https://github.com/Sarasra/models) - The official models used in [Dynamic Routing Between Capsules](https://arxiv.org/abs/1710.09829) 99 | 100 | ### Chainer 101 | - [soskek/dynamic_routing_between_capsules](https://github.com/soskek/dynamic_routing_between_capsules) 102 | 103 | ### CNTK 104 | - [Southworkscom/CapsNet-CNTK](https://github.com/southworkscom/CapsNet-CNTK) 105 | 106 | ### Keras 107 | - [XifengGuo/CapsNet-Keras](https://github.com/XifengGuo/CapsNet-Keras) 108 | - [gusgad/capsule-GAN](https://github.com/gusgad/capsule-GAN) 109 | 110 | ### Matlab 111 | - [yechengxi/LightCapsNet](https://github.com/yechengxi/LightCapsNet) 112 | 113 | ### MXNet 114 | - [Soonhwan-Kwon/capsnet.mxnet](https://github.com/Soonhwan-Kwon/capsnet.mxnet) 115 | 116 | ### PyTorch 117 | - [gram-ai/capsule-networks](https://github.com/gram-ai/capsule-networks) 118 | - [higgsfield/Capsule-Network-Tutorial](https://github.com/higgsfield/Capsule-Network-Tutorial) 119 | - [danielhavir/capsule-network](https://github.com/danielhavir/capsule-network) 120 | 121 | ### R 122 | - [dfalbel/capsnet](https://github.com/dfalbel/capsnet) 123 | 124 | ### TensorFlow 125 | - [naturomics/CapsNet-Tensorflow](https://github.com/naturomics/CapsNet-Tensorflow) 126 | - [bourdakos1/capsule-networks](https://github.com/bourdakos1/capsule-networks) 127 | - [JunYeopLee/capsule-networks](https://github.com/JunYeopLee/capsule-networks) 128 | - [jaesik817/adv_attack_capsnet](https://github.com/jaesik817/adv_attack_capsnet) 129 | - [thibo73800/capsnet-traffic-sign-classifier](https://github.com/thibo73800/capsnet-traffic-sign-classifier) 130 | 131 | ### Torch 132 | - [mrkulk/Unsupervised-Capsule-Network](https://github.com/mrkulk/Unsupervised-Capsule-Network) 133 | 134 | ## EM routing implementations 135 |

PyTorch

136 | 139 | 140 |

TensorFlow

141 | 145 | 146 | ## Other resources 147 | - [Capsule Networks discussion](https://www.facebook.com/groups/1830303997268623) - A Facebook discussion group 148 | - [loretoparisi/CapsNet](https://github.com/loretoparisi/CapsNet) - Loreto Parisi's list of capsule network resources 149 | - [Will capsule networks replace neural networks?](https://www.quora.com/Will-capsule-networks-replace-neural-networks) - A question discussed on Quora 150 | - [Capsule Networks HW](https://github.com/vkantor/Data_Mining_in_Action_2018_Spring/blob/master/trends/data_2/CapsuleNetwork_HW.ipynb) - Homework assignwork in a Python Notebook format 151 | - [CapsNet-Tensorflow](https://gitter.im/CapsNet-Tensorflow/Lobby) - CapsNet-Tensorflow's gitter.im group 152 | 153 | ## License 154 | [![Creative Commons License](http://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/) 155 | 156 | This work is licensed under a [Creative Commons Attribution 4.0 International License](https://creativecommons.org/licenses/by/4.0/). 157 | -------------------------------------------------------------------------------- /diagram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sekwiatkowski/awesome-capsule-networks/6b4d2dec835e3587c0efe1befc526ee8428b2c94/diagram.png --------------------------------------------------------------------------------