ERNIE Versions Save

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

v2.6.0

2 years ago

ERNIE with paddle 2.1

  1. Relative position(ERNIE-gram)
  2. ERNIE-gram demo
  3. multicard-download

v2.5.0

3 years ago

update to paddle-v2.0 new features:

  1. auto mixed-precision training
  2. gradient accumulation

v2.4.0

3 years ago

Reimplemeted ERNIE with paddle.fluid.dygraph (a.k.a eager execution mode), featuring:

  1. Pretrain and finetune ERNIE with PaddlePaddle v1.8.
  2. Eager execution with paddle.fluid.dygraph.
  3. Distributed training.
  4. Easy deployment.
  5. Learn NLP in Aistudio tutorials.
  6. Backward compatibility for old-styled checkpoint

v2.3.0

4 years ago

Update some new Features:

  1. ERNIE-tiny: a distilled ERNIE model for faster online inference (only chinese README provided)
  2. inference demo: C++ code used for CPU/GPU online inference.

v2.2.0

4 years ago

Update some new Features:

  1. Distillation demo.
  2. Paddle High level API: Propeller
  3. python3.5 & python3.7 compatibiliy

More features comming soon:

  1. ERNIE Tiny
  2. ERNIE Service

v2.1.0

4 years ago

update some new features:

  1. auto mixed precision training
  2. multi-processing training
  3. python3 compatibility

more features coming soon:

  1. ERNIE Service
  2. Distillation

v2.0

4 years ago