Repository - AI Projects/Learning

This repo will be helpful in understanding AutoGen providing examples including prompts and agents for SAAS products, how AutoGen works, and diving into the functionality.

Current Library Versions:

Downloads

• Ollama: https://ollama.com/
• LM Studio: https://lmstudio.ai/
• PyCharm Download: https://www.jetbrains.com/pycharm/download
• Anaconda Download: https://www.anaconda.com/download
• Visual Studio Code: https://code.visualstudio.com/
• .NET SDK: https://dotnet.microsoft.com/en-us/download

Need to KNOW:

• MemGPT has been updated recently and if we don't use memgpt configure to set the openai_key, then it won't work with OpenAI API. I opened issue here: https://github.com/tylerprogramming/ai/issues/1
• issues with function calling connected with LM Studio. GPT function calling works, but as soon as the config is swapped for localhost to LM Studio, they are ignored
• NEED to make sure that if using LM Studio, set the UserAgent to have a default auto reply to "..." or something. LM Studio complains about this because of the interaction\
• FFMPEG: must be installed to use Whisper AI
  • MACOS: https://superuser.com/questions/624561/install-ffmpeg-on-os-x
  • WINDOWS: https://phoenixnap.com/kb/ffmpeg-windows

Upcoming Ideas/Projects for Videos

• GPT-4 Vision with AutoGen
• AutoGen with CodeInterpreter
• AutoGen with TeachableAgent (uses Vector DB to remember conversations)
• Auto Generated Agent Chat: Hierarchy flow using select_speaker
• AutoGen Teams, actually creating separate teams that each do a specific thing and pass on what they accomplished to the next one
• Combining GPT-4 Vision with a library that can take a screenshot of a website, perhaps with stocks for example, and examine it
• Create a Sudoku Puzzle Creator/Checker with an AI WorkForce
• Create WebScraper with Puppeteer
• Create AutoGen with Whisper
• Fitness Tracker with multiple models and LMStudio for LocalLLM
• Fitness Expert Bot with Flask Server
• YouTube Services
• Beginner Course
• Intermediate Course
• Advanced Course

Updates:

• 05/03/2024 - added directory for frontend code saving and example .net code