Best 1 Preference Data Open Source Projects

Argilla Io Notus

Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or...