Tflite Android Transformers Save

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

Project README

TensorFlow Lite Transformers w/ Android demos

Convert Transformers models imported from the 🤗 Transformers library and use them on Android. You can also check out our swift-coreml-transformers repo if you're looking for Transformers on iOS.

Question Answering with DistilBERT

Demo of the DistilBERT model (97% of BERT’s performance on GLUE) fine-tuned for Question answering on the SQuAD dataset. It provides 48 passages from the dataset for users to choose from.

demo gif

Text Generation with GPT-2/DistilGPT2

On-device text generation using GPT-2 or DistilGPT2 (same distillation process than DistilBERT, 2x faster and 33% smaller than GPT-2)

demo gif


Models generation

Example scripts used to convert the models are available in the models_generation directory. Please note that they require the nightly version of TensorFlow and might thus be unstable.

License

Apache License 2.0

Open Source Agenda is not affiliated with "Tflite Android Transformers" Project. README Source: huggingface/tflite-android-transformers
Stars
372
Open Issues
16
Last Commit
8 months ago
License

Open Source Agenda Badge

Open Source Agenda Rating