Llm Tuning Hub Versions Save

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

v0.2.1

1 month ago

What's Changed

Bug Fix - llmtune generate config not finding the yml file by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/150

Full Changelog: https://github.com/georgian-io/LLM-Finetuning-Toolkit/compare/v0.2.0...v0.2.1

v0.2.0

1 month ago

What's Changed

DOCS(README.md): Fix typo by @akashsaravanan-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/138
jsonl format support by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/136
[CLI] Generate Example config.yml anywhere via llmtune generate config by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/137
Flash Attention Implementation & Fuller Config Options by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/139
Remove unused accelerate code by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/145
Better Starter Config by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/146
Better Handling of Logs and Warnings for UI by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/148

Full Changelog: https://github.com/georgian-io/LLM-Finetuning-Toolkit/compare/v0.1.4...v0.2.0

v0.1.4

1 month ago

This release attempts to resolve issue where README images are not showing up in PyPI

What's Changed

README image reference update by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/128

Full Changelog: https://github.com/georgian-io/LLM-Finetuning-Toolkit/compare/v0.1.3...v0.1.4

v0.1.3

1 month ago

This release made changes and corrections to README and pyproject.toml metadata.

What's Changed

README Image to use full link by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/125
Correction to container image link by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/126
Update pyproject.toml Metadata by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/127

Full Changelog: https://github.com/georgian-io/LLM-Finetuning-Toolkit/compare/v0.1.2...v0.1.3

v0.1.2

1 month ago

This marks our first official release of the Finetuning Toolkit! 🥳 If you would like to see our previous research content, please visit legacy/llm-finetuning-hub branch

What's Changed

Update README.md by @georgianpoole in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/1
Update README.md by @georgianpoole in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/2
save metrics dictionary to experiment folder by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/3
code formatted using black by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/4
update packages by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/5
fix LinkedIn and email links by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/7
removed the dev version by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/8
FastApi and load testing by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/9
removed content sub-heading by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/11
added tiktoken by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/12
changed folder name by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/13
Central/change folder path by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/14
Flan/testing by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/15
Text Generation Inference by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/16
Fixed readme by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/17
updates to image paths by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/18
update ablation section by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/19
update readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/20
Falcon/add scripts by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/21
update model specification by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/22
Added falcon by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/23
Falcon/update readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/24
added redpajama scripts by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/25
Redpajama/test code by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/26
Red Pajama by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/27
Fix readme by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/28
Readme/update by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/30
update correspondence section by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/31
remove redundant scripts by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/32
update links to codebase and readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/33
Model/llama2 by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/35
Update requirements by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/36
Update readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/37
LLama by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/38
Feat(palmyra/): Add code to run palmyra through api. by @akashsaravanan-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/29
update roadmap by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/39
update links by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/40
Inference by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/42
Ai21/jurassic by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/44
Update readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/45
update link to jurassic-2 folders by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/46
scrub info by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/47
Openai by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/48
updated files by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/49
update gpt status by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/50
Mosaic by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/51
update mosaic status by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/52
Mistral by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/53
Readme update by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/54
Zephyr Benchmarks by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/60
updated main README for zephyr by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/63
Automated deployment by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/62
LLM Finetuning Toolkit by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/67
Toolkit - Ablation Studies by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/72
Update README.md by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/73
Toolkit Environment Management by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/74
Notebook for TMLS by @mariia-georgian in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/61
Implemented LLM performance test cases by @VivekSinghDS in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/76
Feature llm qa by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/77
Cohere by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/78
Feature/finetune refactor by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/79
Feature/llm qa directory setup by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/80
Feature/UI abstraction by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/81
Fixed typo in accuracy by @balmasi in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/82
Hotfix/qa test methods by @VivekSinghDS in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/84
patching method name by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/86
Hotfix/bug fix UI merge by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/87
Hotfix/quant config fix by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/88
[Vulnerabillity] Version bump black to address vulnerability #14 by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/91
Update issue templates by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/85
Release/new directory structure by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/92
Release/toolkit readme by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/94
change to section by @RohitSaha in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/95
downgrade and restrict transformer and trl versioning by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/96
updated changes by @VivekSinghDS in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/99
[CLI] Parameter for Config Path by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/100
[Package] Changing source directory name by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/102
[Workflow] Automatically Lint and Format PRs by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/116
Add PIPY and update README by @truskovskiyk in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/115
Modify Script Entrypoint to be llmtune instead of python toolkit.py by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/118
[CI] Publish to PyPI upon Tag by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/121
[CI] Publish to Github Packages (ghcr) by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/122
Update README.md by @benjaminye in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/123

New Contributors

@georgianpoole made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/1
@RohitSaha made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/3
@mariia-georgian made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/9
@akashsaravanan-georgian made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/29
@benjaminye made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/60
@VivekSinghDS made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/76
@balmasi made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/82
@truskovskiyk made their first contribution in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/115

Full Changelog: https://github.com/georgian-io/LLM-Finetuning-Toolkit/commits/v0.1.2