Finetune any model on HF in less than 30 seconds
Finetune any model with unparalled performance, speed, and reliability using Qlora, BNB, Lora, Peft in less than 30 seconds, just press GO.
Book a 1-on-1 Session with Kye, the Creator, to discuss any issues, provide feedback, or explore how we can improve Zeta for you.
$ pip3 install ft-suite
from fts import FineTuner
# Initialize the fine tuner
model_id="google/flan-t5-xxl"
dataset_name = "samsung"
tuner = FineTuner(
model_id=model_id,
dataset_name=dataset_name,
max_length=150,
lora_r=16,
lora_alpha=32,
quantize=True
)
# Generate content
prompt_text = "Summarize this idea for me."
print(tuner(prompt_text))
from fts import Inference
model = Inference(
model_id="georgesung/llama2_7b_chat_uncensored",
quantized=True
)
model.run("What is your name")
from fts import GPTQInference
model_id = "facebook/opt-125m"
model = GPTQInference(model_id=model_id, max_length=400)
prompt = "in a land far far away"
result = model.run(prompt)
print(result)
World-Class Quantization: Get the most out of your models with top-tier performance and preserved accuracy! 🏋️♂️
Automated PEFT: Simplify your workflow! Let our toolkit handle the optimizations. 🛠️
LoRA Configuration: Dive into the potential of flexible LoRA configurations, a game-changer for performance! 🌌
Seamless Integration: Designed to work seamlessly with popular models like LLAMA, Falcon, and more! 🤖
Here's a sneak peek into our ambitious roadmap! We're always evolving, and your feedback and contributions can shape our journey! ✨
More Example Scripts:
Polymorphic Preprocessing Function:
Extended Model Support:
Comprehensive Documentation:
Interactive Web Interface:
Advanced Features:
... And so much more coming up!
We're excited about the journey ahead and would love to have you with us! For feedback, suggestions, or contributions, feel free to open an issue or a pull request. Let's shape the future of fine-tuning together! 🌱
MIT
Spread the message of the Finetuning-Suite, this is an foundational tool to help everyone quantize and finetune state of the art models.
Sharing the project helps us reach more people who could benefit from it, and it motivates us to continue developing and improving the suite.
Click the buttons below to share Finetuning-Suite on your favorite social media platforms:
Also, we'd love to see how you're using Finetuning-Suite! Share your projects and experiences with us by tagging us on Twitter @finetuning-suite.
Lastly, don't forget to ⭐️ the repository if you find it useful. Your support means a lot to us! Thank you! 💙