RWKV Runner Versions Save

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

v1.7.1

3 months ago

Changes

This version includes important bug fixes, it is strongly recommended to upgrade to this version.

Upgrades

Features

  • allow setting quantizedLayers of WebGPU mode

Improvements

  • improve occurrence[token] condition
  • disable AVOID_PENALTY_TOKENS when generating (still enabled when preprocessing)
  • enable useHfMirror by default for chinese users

Fixes

  • fix the issue where state cache could be modified leading to inconsistent hit results
  • fix convert_safetensors.py for rwkv6
  • add python3-dev to lora fine-tune dependencies (this may previously lead to the error of v5 fine-tune)

Chores

  • hide MPS and CUDA-Beta Options
  • update manifest

Install

v1.7.0

3 months ago

Changes

Upgrades

  • rwkv 0.8.25 (fix v6 fp16i8)

Fixes

  • fix /update-config can make the default value of unclearly specified fields invalid by passing in None fields

Chores

  • change AVOID_PENALTY to \n only
  • chores

Install

v1.6.9

3 months ago

Changes

Upgrades

Features

  • add markdown renderer switch
  • allow loading conversation
  • allow setting history message number
  • expose penalty_decay, top_k
  • add AVOID_PENALTY_TOKENS
  • add parse_api_log.py, this script can extract formatted data from api.log

Improvements

  • improve macos experience
  • improve fine-tune performance
  • add better custom tokenizer support and tokenizer-midipiano.json
  • improve path processing
  • add EOS state cache point
  • reduce package size

Fixes

  • fix WSL2 WindowsOptionalFeature: Microsoft-Windows-Subsystem-Linux -> VirtualMachinePlatform
  • fix finetune errorsMap ($modelInfo)

Chores

  • update defaultPresets
  • update defaultModelConfigs
  • rename manifest tag "Main" -> "Official"
  • update manifest.json
  • update Related Repositories
  • other minor changes

Install

v1.6.8

4 months ago

Changes

  • abc music inference support
  • basic abc frontend support
  • fix finetune errorsMap ($modelInfo)

Install

v1.6.7

5 months ago

Changes

  • rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)
  • improve memory usage and speed of convert_safetensors.py
  • webgpu(python) state cache support
  • improve state cache performance (especially for rwkv.cpp)
  • chore

Install

v1.6.6

5 months ago

Changes

  • improve refreshRemoteModels
  • reduce precompiled web_rwkv_py size
  • webgpu(Python) max_buffer_size (12B support) and turbo
  • improve role-playing effect
  • update manifest.json (a lot of new models)
  • bump webgpu(ai00_server) mode to v0.3.8
  • improve details

Install

v1.6.5

5 months ago

Changes

  • update midi_filter_config.json
  • Composition Option: Only Auto Play Generated Content

Install

v1.6.4

5 months ago

Changes

  • WebGPU (Python) strategy

Install

v1.6.3

5 months ago

Changes

Install

v1.6.2

5 months ago

Changes

  • rwkv.cpp python38 compatibility
  • improve rwkv.cpp operation prompts
  • add load failed traceback
  • fix windows cmd waiting

Install