Best 2 Long Context Attention Open Source Projects

Block Recurrent Transformer Pytorch

Implementation of Block Recurrent Transformer - Pytorch

Flash Attention Jax

Implementation of Flash Attention in Jax