A Web app stack written in FastAPI, Qdrant, and React for creating AI projects
A minimal code base for creating AI apps to do Question Answering (QA) over PDF documents, completely locally.
This project is inspired by local-ai-stack. However, their stack is entirely javascript based, and I needed a python based backend, so decided to create this project.
https://github.com/mallahyari/ai-starter-kit/assets/28068313/5b65f268-d5e2-499e-92ca-38dc4067e940
git clone https://github.com/mallahyari/ai-starter-kit.git
cd backend/app
pip install -r requirements.txt
cd frontend
npm install
docker run -p 6333:6333 qdrant/qdrant
Install Ollama Instructions are here
Run the FastApi server (from inside backend
directory):
python app/main.py
frontend
):npm start
You can change configurations in .config
file, such as the embedding model, chunk size, and chunk overlap. If you plan to use Qdrant Cloud, you can or you can create your own .env
file and set necessary api keys.
Although current app only support pdf files, it's very straightforward to add other types of files such as text files, etc. Also, you can easily add the open-ended chat in addition to QA over document use case.
If you have any comment or feedback, please don't hesitate to use the Discussions
section and open a new topic. You can also reach out directly via Linkedin or Twitter