UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
lora_modules_to_save
8bit
, FP16
, BF16
, gradient_checkpointing
trainalbe%
will be logged to wandb under config model.trainable%
, model.all_params
and model.trainable_params
.