Xturing Versions Save

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

v0.1.8

8 months ago

Stability and documentation

  • New version of Documentation is live, thanks to @tushar2407.
  • Updated contribution guide.
  • Stability improvements and bugfixing.
  • int8 generation now works even better.

v0.1.7

9 months ago

Evaluation and documentation, CPU support

  • Evaluation of finetuned models, thanks to @tushar2407.
  • Llama2 model support and enchantments of Generic models.
  • Batch size support for both evaluation and generation.
  • CPU inference and finetuning.
  • Documentation and examples, thanks to @tushar2407.

v0.1.6

9 months ago

INT4 models

  • INT4 Generic model now supports large variety of open source models finetuning in INT4, thanks to @tushar2407.
  • All INT4 finetunings are now much stable and work on large variety of GPUs.
  • Support of flags for models loading, thanks to @msinha251.
  • Documentation enchantment and bug fix, thanks to @tushar2407.

v0.1.5

10 months ago
  • Changing BaseModel to work with LoRA after previous release, thanks to @tushar2407

v0.1.4

10 months ago

New models and logging

  • Generic model to support large variety of open source models, thanks to @tushar2407
  • Falcon model support as a latest open source model release, thanks to @tushar2407
  • Documentation enchantment, again, big thanks to @tushar2407
  • Logger integration and refactoring, thanks to @Georgehe4

v0.1.3

11 months ago

Bugs and fixes

  • Fixed issues with INT8 and INT4 model saving and loading after fine-tuning
  • Dataset from different sources saving fixes
  • Hub loading progress bar fixing, replaced old model formats
  • Added generic Wandb integration, thanks to #180 by @cnbeining

v0.1.2

1 year ago

Bugs and fixes

  • Improved default generation parameters for all models
  • Fixed issue of both INT8 and INT4 generation like https://github.com/stochasticai/xturing/issues/167. Added correct model weights mapping for INT4
  • Bumped transformers version to 4.28.1
  • Fix hub recursive downloads

v0.1.1

1 year ago

Bug fix

  • There was an issue with printing parameters of GPT-2 model. Exception handling is added.

v0.1.0

1 year ago

INT4 generation added

  • While we already supported INT4 fine-tuning through Docker, it wasn't complete. This release allows you to perform INT4 fine-tuning and INT4 generation as part of the xTuring pipeline