CapsNet

CapsNet (Capsules Net) in Geoffrey E Hinton paper "Dynamic Routing Between Capsules"

• What's New

Table of Contents

• What's New
• Abstract
• Documentation :new:
• Discussions Groups
• Official Implementations
• Proof of Work
• Implementations by Framework
• Implementations By Dataset
• Implementations By Task
• Translations
• Other Resources

What's New

Webinar

• Pytorch Live Talks t.1 – Capsules and routing techniques (part 1/2), Alfredo Canziani :new:

Implementations By Dataset

Toxic Comment Challenge (Kaggle)

• chongjiujjin/capsule-net-with-gru

Abstract

We cover here the last and most interesting paper's abstract about Capsule Networks.

We introduce a new routing algorithm for capsule networks, in which a child capsule is routed to a parent based only on agreement between the parent's state and the child's vote. The new mechanism 1) designs routing via inverted dot-product attention; 2) imposes Layer Normalization as normalization; and 3) replaces sequential iterative routing with concurrent iterative routing. When compared to previously proposed routing algorithms, our method improves performance on benchmark datasets such as CIFAR-10 and CIFAR-100, and it performs at-par with a powerful CNN (ResNet-18) with 4x fewer parameters. On a different task of recognizing digits from overlayed digit images, the proposed capsule model performs favorably against CNNs given the same number of layers and neurons per layer. We believe that our work raises the possibility of applying capsule networks to complex real-world tasks. Our code is publicly available at: https://github.com/apple/ml-capsules-inverted-attention-routing An alternative implementation is available at: https://github.com/yaohungt/Capsules-Inverted-Attention-Routing/blob/master/README.md

Excerpt from CAPSULES WITH INVERTED DOT-PRODUCT ATTENTION ROUTING, Yao-Hung Hubert Tsai, , Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov, ICLR 2020 :new:

UP

Documentation

Papers

• CAPSULES WITH INVERTED DOT-PRODUCT ATTENTION ROUTING, Yao-Hung Hubert Tsai, , Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov, ICLR 2020
• Dynamic Routing Between Capsules, Sara Sabour, Nicholas Frosst, Geoffrey E Hinton, 26 Oct 2017
• MATRIX CAPSULES WITH EM ROUTING, Anonymous authors, ICLR 2018
• Does the Brain do Inverse Graphics?, Geoffrey Hinton, Alex Krizhevsky, Navdeep Jaitly, Tijmen Tieleman & Yichuan Tang, Department of Computer Science, University of Toronto, GSS 2012.
• CapsuleGAN: Generative Adversarial Capsule Network Ayush Jaiswal, Wael AbdAlmageed, Premkumar Natarajan, USC Information Sciences Institute, Feb 2018
• Brain Tumor Type Classification via Capsule Networks Parnian Afshar, Arash Mohammadi, Konstantinos N. Plataniotis
• Improved Explainability of Capsule Networks: Relevance Path by Agreement Atefeh Shahroudnejad, Arash Mohammadi, Konstantinos N. Plataniotis
• Investigating Capsule Networks with Dynamic Routing for Text Classification Wei Zhao, Jianbo Ye, Min Yang, Zeyang Lei, Suofei Zhang, Zhou Zhao
• Capsules for Object Segmentation Rodney LaLonde, Ulas Bagci
• Investigating Capsule Networks with Dynamic Routing for Text Classification Wei Zhao, Jianbo Ye3, Min Yang1, Zeyang Lei4 , Soufei Zhang5 , Zhou Zhao6
• The Multi-Lane Capsule Network (MLCN) Vanderson M. do Rosario, Edson Borin, Mauricio Bretenitz Jr., Feb 2019
• From Attention in Transformers to Dynamic Routing in Capsule Nets
• TextCaps : Handwritten Character Recognition with Very Small Datasets
• DeepCaps: Going Deeper with Capsule Networks
• Avoiding Implementation Pitfalls of "Matrix Capsules with EM Routing" by Hinton et al. Ashley Gritzman, Aug 2019
• A Neural-Symbolic Architecture for Inverse Graphics Improved by Lifelong Meta-Learning
• Adding Intuitive Physics to Neural-Symbolic Capsules Using Interaction Networks:new:
• Capsule Routing via Variational Bayes
• Building Deep, Equivariant Capsule Networks
• Stacked Capsule Autoencoders, Adam R. Kosiorek, Sara Sabour, Yee Whye Teh, Geoffrey E. Hinton, 17 Jun 2019, revised 2 Dec 2019
• Capsule Routing via Variational Bayes, Fabio De Sousa Ribeiro, Georgios Leontidis, Stefanos Kollias, 27 May 2019 (v1), last revised 3 Dec 2019
• CAPSULES WITH INVERTED DOT-PRODUCT ATTENTION ROUTING, Yao-Hung Hubert Tsai, , Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov, ICLR 2020 :new:

UP

Articles

• Understanding Hinton’s Capsule Networks. Part I: Intuition.
• Understanding Hinton’s Capsule Networks. Part II: How Capsules Work.
• Understanding Hinton’s Capsule Networks. Part III: Dynamic Routing Between Capsules.
• Understanding Hinton’s Capsule Networks. Part IV: CapsNet Architecture :new:
• What is a CapsNet or Capsule Network?
• Understanding Dynamic Routing between Capsules (Capsule Networks)
• Matrix capsules with EM routing
• Capsule Networks Explained
• Capsule Networks Are Shaking up AI — Here’s How to Use Them
• Understanding Capsule Networks — AI’s Alluring New Architecture

UP

Tutorials

• Understand and apply CapsNet on Traffic sign classification
• Running CapsuleNet on TensorFlow

Presentations

• Dynamic Routing Between Capsules

Webinar :new:

• Pytorch Live Talks t.1 – Capsules and routing techniques (part 1/2), Alfredo Canziani :new:
• Capsule Networks: An Improvement to Convolutional Networks - Siraj Raval

Discussion Groups

• CapsNet-Tensorflow
• Capsule Networks discussion - Facebook
• Could GANs work with Hinton's capsule theory? :new:

Official Implementations

The implementations has been considered to be official since the authors were directly involved in the papers as co-authors or they had some references.

• Sarasra/models
• apple/ml-capsules-inverted-attention-routing

Proof of Work

• Adversarial Attack to Capsule Networks :new:

Other Resources

• A curated list of awesome resources related to capsule networks

Implementations by Framework

Pytorch

• mavanb/capsule_network_pytorch
• leftthomas/CapsNet
• dragen1860/CapsNet-Pytorch
• gram-ai/capsule-networks
• andreaazzini/capsnet.pytorch
• CapsNet-PyTorch
• Ujjwal-9/CapsNet
• cedrickchee/capsule-net-pytorch
• laubonghaudoi/CapsNet_guide_PyTorch
• tonysy/CapsuleNet-PyTorch
• AlexHex7/CapsNet_pytorch
• leftthomas/CCN
• gram-ai/capsule-networks
• fabio-deep/Variational-Capsule-Routing
• apple/ml-capsules-inverted-attention-routing :new:

Pytorch + CUDA

• leftthomas/CapsuleLayer
• bakirillov/capsules

Jupyter Notebook

• acburigo/CapsNet
• leoniloris/CapsNet
• ruslangrimov/capsnet-with-capsulewise-convolution
• aliasvishnu/Capsule-Networks-Notebook-MNIST
• adambielski/CapsNet-pytorch
• rrqq/CapsNet-tensorflow-jupyter

Torch

• leftthomas/FCCapsNet

Tensorflow

• IBM/matrix-capsules-with-em-routing
• naturomics/CapsNet-Tensorflow
• InnerPeace-Wu/CapsNet-tensorflow
• laodar/tf_CapsNet
• nnUyi/CapsNet
• tjiang31/CapsNet
• rrqq/CapsNet-tensorflow-jupyter
• winwinJJiang/capsNet-Tensorflow
• etendue/CapsNet_TF
• thibo73800/capsnet_traffic_sign_classifier
• bourdakos1/capsule-networks
• jostosh/capsnet
• alisure-ml/CapsNet
• bourdakos1/CapsNet-Visualization
• andyweizhao/capsule_text_classification :new:

Keras

• XifengGuo/CapsNet-Keras
• XifengGuo/CapsNet-Fashion-MNIST
• sunxirui310/CapsNet-Keras
• theblackcat102/dynamic-routing-capsule-cifar
• streamride/CapsNet-keras-imdb
• fengwang/minimal-capsule
• vinojjayasundara/textcaps
• Kayzaks/VividNet :new:

UP

MXNet

• AaronLeong/CapsNet_Mxnet)
• Soonhwan-Kwon/capsnet.mxnet
• GarrickLin/Capsnet.Gluon

CNTK

• Southworkscom/CapsNet-CNTK

Lasagne

• DeniskaMazur/CapsNet-Lasagne

Chainer

• soskek/dynamic_routing_between_capsules

Matlab

• yechengxi/LightCapsNet

R

• dfalbel/capsnet

C++

• MxAR/CapsNet.cpp

C

• MxAR/CapsNet.c

JavaScript

• alseambusher/capsnet.js

Vulcan

• moothyknight/CapsNet-for-Graphics-Rendering-Optimization

Other

• jaesik817/adv_attack_capsnet

UP

Implementations By Dataset

MNIST

• leftthomas/CapsNet
• dragen1860/CapsNet-Pytorch
• gram-ai/capsule-networks
• andreaazzini/capsnet.pytorch
• CapsNet-PyTorch
• Ujjwal-9/CapsNet
• cedrickchee/capsule-net-pytorch
• laubonghaudoi/CapsNet_guide_PyTorch
• tonysy/CapsuleNet-PyTorch
• leftthomas/FCCapsNet
• naturomics/CapsNet-Tensorflow
• InnerPeace-Wu/CapsNet-tensorflow
• laodar/tf_CapsNet
• nnUyi/CapsNet
• tjiang31/CapsNet
• rrqq/CapsNet-tensorflow-jupyter
• winwinJJiang/capsNet-Tensorflow
• etendue/CapsNet_TF
• Southworkscom/CapsNet-CNTK

IMDB Reviews

• streamride/CapsNet-keras-imdb

Cifar 10

• theblackcat102/dynamic-routing-capsule-cifar

BanglaLekha-Isolated Dataset:

• codeheadshopon/CapsNet_BanglaLekha

Traffic Sign Dataset (German):

• thibo73800/capsnet_traffic_sign_classifier

Iceberg Classification Challenge (Kaggle)

• sdhayalk/CapsNet-for-Iceberg-or-Submarine-Classification
• leftthomas/IcebergClassifier

Toxic Comment Challenge (Kaggle)

• chongjiujjin/capsule-net-with-gru

UP

Implementations by Task

Text Classification

• andyweizhao/capsule_text_classification :new:

Speech Recognition

• SvenDH/CapsNet-ASR

Emotion Recognition

• mitiku1/Emopy-CapsNet

Named Entity Recognition (NER)

• Chucooleg/CapsNet_for_NER

Natural Language Processing (NLP)

• stefan-it/capsnet-nlp

UP

Translations

Japanese

• CapsNetについての調べ - (JAPANESE)

Turkish

• deeplearningturkiye/kapsul-agi-capsule-network

UP