Sparse Autoencoders Save

Sparse Autoencoders

Sparsity constraint is imposed here by using a KL-Divergence penalty. See this for a detailed explanation of sparse autoencoders.

The FashionMNIST dataset was used for this implementation. Figures shown below are obtained after 1 epoch:

Using sparsity penalty:

Normal autoencoder