This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras
Research Paper | Python Code |
---|---|
Paper | Code |
Luong attention and Bahdanau attention
https://github.com/monk1337/Tensorflow-Attention-mechanisms
#Images source : http://cnyah.com/2017/08/01/attention-variants/