World's First Multilingual Inexpensive Therapeutic Sophisticated Ultra-responsive Holographic Agent. In simple terms, an AI you can talk to and it'll talk back with a body using VTube Studio.
Redefining Reality
Demo video with 3D printed hologram box
·
Report Bug
·
Request Feature
A virtual waifu / assistant that you can speak to through your mic and it'll speak back to you! Has many features such as:
More features I'm planning to add soon in the Roadmap. Also, here's a summary of how it works for those of you who want to know:
First, the Python package SpeechRecognition recognizes what you say into your mic, then that speech is written into an audio (.wav) file, which is sent to OpenAI's Whisper speech-to-text transcription AI, and the transcribed result is printed in the terminal and written in a conversation.jsonl which the vector database hyperdb uses cosine similarity on to find 2 of the closest matches to what you said in the conversation.jsonl and appends that to the prompt to give Megumin context, the response is then passed through multiple NLE RTE and other checks to see if you want to open an app or do something with your smarthome, the prompt is then sent to llama.cpp, and the response from Megumin is printed to the terminal and appended to conversation.jsonl, and finally, the response is spoken by VITS TTS.
Desktop Development with C++
in the install optionsOpen Data Folder
and move the folder there > Person icon > c001_f_costume_koumaListen to this device
> For Playback through this device
, select your headphones or speakersgit clone --recurse-submodules https://github.com/DogeLord081/OneReality.git
python setup.py
and follow the instructions.env
if you mustOneReality.bat
and while it's running, open the start menu and type Sound Mixer Options
and open it. You might have to wait and make Megumin say something first, but you should see Python in the App Volume listCABLE Input (VB-Audio Virtual Cable)
Sound Mixer Options
again and change the input for VTube Studio to CABLE Output (VB-Audio Virtual Cable)
Distributed under the GNU General Public License v3.0 License. See LICENSE.txt
for more information.
E-mail: [email protected]
YouTube: https://www.be.com/@OneReality-tb4ut
Discord: https://discord.gg/PN48PZEXJS
Project Link: https://github.com/DogeLord081/OneReality