Xllm Versions Save

What's Changed

• DeepSpeed on single GPU by @BobaZooba in https://github.com/BobaZooba/xllm/pull/8
• Add project_name by @BobaZooba in https://github.com/BobaZooba/xllm/pull/11
• set transformers version by @BobaZooba in https://github.com/BobaZooba/xllm/pull/12
• Download model without loading to RAM by @BobaZooba in https://github.com/BobaZooba/xllm/pull/13

Full Changelog: https://github.com/BobaZooba/xllm/compare/0.1.7...0.1.8

What's Changed

• Tokenizer trust remote code by @BobaZooba in https://github.com/BobaZooba/xllm/pull/2

What's Changed

• Int8 fusing by @BobaZooba in https://github.com/BobaZooba/xllm/pull/1

Full Changelog: https://github.com/BobaZooba/xllm/compare/0.1.1...0.1.2

🎉 Code and documents done!

Useful materials

• Quickstart: basics of xllm
• Examples: minimal examples of using xllm
• Guide: here, we go into detail about everything the library can do
• Demo project: here's a minimal step-by-step example of how to use X—LLM and fit it into your own project
• WeatherGPT: this repository features an example of how to utilize the xllm library. Included is a solution for a common type of assessment given to LLM engineers, who typically earn between $120,000 to $140,000 annually
• Shurale: project with the finetuned 7B Mistal model

Code done and tested. Time to docs