LLaMA LoRA Tuner Versions Save

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

v0.0.20230421

1 year ago

New Features

Fine-tuning

  • "Continue from model" now supports using a remote model from Hugging Face Hub.
  • New advanced fine-tune arg: lora_modules_to_save
  • New advanced fine-tune arg: 8bit, FP16, BF16, gradient_checkpointing
  • Support passing additional LoraConfig and TrainingArguments.
  • "Load training parameters from selected model" will now also load the prompt template and dataset.
  • Model trainalbe% will be logged to wandb under config model.trainable%, model.all_params and model.trainable_params.

v0.0.20230420

1 year ago