:computer: MonikA.I. submod

About the project

This project aims to add new AI based features to Monika After Story mod with the submod API. It's using multiple AI models:

• text-generation-webui
• TTS Coqui-AI and Tortoise-TTS for Text to Speech
• OpenAI Whisper with microphone option for Speech to Text
• Emotion detection from text model is also used linked with the chatbot
• NLI Classification with deberta

Check the discord server if you have some questions or if you want to be up to date with new fixes and releases !

Getting Started

Prerequisites

The submod is compatible with the latest version of MAS (v0.12.15). It has been tested on Windows 10/11 with Python 3.9. A manual installation is also possible on Linux or MacOS.

Installation

:eight_spoked_asterisk: User version installation (Windows)

This version includes conversing with chatbots or full voicing of the game, the two modes might not be compatible so it is preferable to use them separetely.

To install the user version with executables, a tutorial is avilable here after version 2.0.

:penguin: Python version (Linux or MacOS)

Wiki page HERE

Usage

:fire: Features

• Speak without scripted text with Monika using any chatbots compatible with text-generation-webui
• Hear Monika speak with a Text to Speech module using extracts of voiced dialogues
• Talk with your own voice with Monika thanks to Speech recognition
• Let Monika control actions in the game directly from your chat with her

:star2: Chatbots

Be sure to follow the instructions here to use conversational AI models running locally.

:warning: Usage information

After installation is completed, check the common information for usage on this page

How to contribute

If you want to contribute to the project, you can check out this page. It is not necessary to know how to code and you can add dialogs or expressions. Don't hesitate to propose new things if you have more experience !

Demonstrations

:video_game: In Game

The features are available in a specific AI Talk menu in the game.

• Click on Let's chat together to use the Character AI Chatbot
• Click on Tell me about Pytorch if you think it is superior to Tensorflow

There is also the possibility of using buttons on the main screen to directly chat. These can be disabled in the Settings Submods if you don't like them.

:cinema: Video Demonstration

https://user-images.githubusercontent.com/66365083/209359921-a4fdad5e-abbd-4550-a1fb-62d695e76c51.mp4