Nn Save

?‍? 59 Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Project README

Twitter Sponsor

labml.ai Deep Learning Paper Implementations

This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations,

The website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better.

Screenshot

We are actively maintaining this repo and adding new implementations almost weekly. Twitter for updates.

Paper Implementations

Transformers

Recurrent Highway Networks

LSTM

HyperNetworks - HyperLSTM

ResNet

ConvMixer

Capsule Networks

U-Net

Generative Adversarial Networks

Diffusion models

Sketch RNN

✨ Graph Neural Networks

Counterfactual Regret Minimization (CFR)

Solving games with incomplete information such as poker with CFR.

Reinforcement Learning

Optimizers

Normalization Layers

Distillation

Adaptive Computation

Uncertainty

Activations

Sampling Techniques

Eleuther GPT-NeoX

Scalable Training/Inference

Highlighted Research Paper PDFs

Installation

pip install labml-nn

Citing

If you use this for academic research, please cite it using the following BibTeX entry.

@misc{labml,
 author = {Varuna Jayasiri, Nipun Wijerathne},
 title = {labml.ai Annotated Paper Implementations},
 year = {2020},
 url = {https://nn.labml.ai/},
}

Other Projects

This shows the most popular research papers on social media. It also aggregates links to useful resources like paper explanations videos and discussions.

? labml.ai/labml

This is a library that let's you monitor deep learning model training and hardware usage from your mobile phone. It also comes with a bunch of other tools to help write deep learning code efficiently.

Open Source Agenda is not affiliated with "Nn" Project. README Source: labmlai/annotated_deep_learning_paper_implementations

Open Source Agenda Badge

Open Source Agenda Rating