AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
This release was manually made instead of automatically deployed with a proper CI/CD workflow.
No idea what that meant? That's fine. In the near future, I'd like to have all of the supported platforms included as a GitHub Release. For the time being, I have manually built & uploaded a few files just to get at least 1 pre-compiled (ready-to-go) app out in the wild.
Inside the zip macOS_AubAI.app.zip file, you should see one file: AubAI.app. Double click to open and try out any <filename.gguf> which is the AI / LLM model that can be found on websites such as HuggingFace.co. The example app is using ChatML as the prompt template which cannot be changed within the app yet.
If you're a (Flutter) developer, remember that you can still try the app on any platform. What you need to do is navigate to the example/ directory and like any other Flutter app, execute:flutter run.