A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
presystem
to falseFor the convenience of using the future state-tuned models, the default value of presystem
has been set to false. This means that the RWKV-Runner service will no longer automatically insert recommended RWKV pre-prompts for you:
User: hi
Assistant: Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.
If you are using the API service and conducting a rigorous RWKV conversation, please manually send the above messages to the /chat/completions
API's messages
array, or manually send presystem: true
to have the server automatically insert pre-prompts.
If you are using the RWKV-Runner client for chatting, you can enable Insert default system prompt at the beginning
in the preset editor.
Of course, in reality, even if you do not perform the above, there is usually no significant negative impact.
If you are using the new RWKV state-tuned models, you do not need to perform the above.
The new RWKV state-tuned models can be downloaded here, they are very interesting:
If you are interested in state-tuning, please refer to: https://github.com/BlinkDL/RWKV-LM#state-tuning-tuning-the-initial-state-zero-inference-overhead