+1
日增长
9,487
stars
685
forks
91
watchers
90
prs
125
issues
0
releases
README
ChatRWKV (pronounced as "RwaKuv" (rʌkuv in IPA), from 4 major params: R W K V)
RWKV homepage: https://www.rwkv.com
RWKV-7 code: https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7
ChatRWKV is like ChatGPT but powered by my RWKV (100% RNN) language model, which is the only RNN (as of now) that can match transformers in quality and scaling, while being faster and saves VRAM.
Our latest version is RWKV-7 https://arxiv.org/abs/2503.14456 (Preview models: https://huggingface.co/BlinkDL/temp )
Gradio Demo 1: https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-1
Gradio Demo 2: https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2
RWKV-LM main repo: https://github.com/BlinkDL/RWKV-LM (explanation, fine-tuning, training, etc.)
Chat Demo for developers: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
Efficient inference project: https://github.com/BlinkDL/Albatross
RWKV APP: https://github.com/RWKV-APP/RWKV_APP (local inference for Android / iOS)
RWKV Discord: https://discord.gg/bDSBUMeFpc (7k+ members)
Twitter: https://twitter.com/BlinkDL_AI
Homepage: https://www.rwkv.com/
Raw cutting-edge RWKV weights: https://huggingface.co/BlinkDL
GGUF: https://huggingface.co/collections/shoumenchougou/rwkv7-gxx-gguf
HF-compatible RWKV weights: https://huggingface.co/RWKV
Use v2/convert_model.py to convert a model for a strategy, for faster loading & saves CPU RAM.
Note RWKV_CUDA_ON will build a CUDA kernel (much faster & saves VRAM). Here is how to build it ("pip install ninja" first):
How to build in Linux: set these and run v2/chat.py
export PATH=/usr/local/cuda/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
How to build in win:
Install VS2022 build tools (https://aka.ms/vs/17/release/vs_BuildTools.exe select Desktop C++). Reinstall CUDA 11.7 (install VC++ extensions). Run v2/chat.py in "x64 native tools command prompt".
RWKV pip package: https://pypi.org/project/rwkv/ (please always check for latest version and upgrade)
https://github.com/cgisky1980/ai00_rwkv_server Fastest GPU inference API with vulkan (good for nvidia/amd/intel)
https://github.com/cryscan/web-rwkv backend for ai00_rwkv_server
https://github.com/saharNooby/rwkv.cpp Fast CPU/cuBLAS/CLBlast inference: int4/int8/fp16/fp32
https://github.com/JL-er/RWKV-PEFT lora/pissa/Qlora/Qpissa/state tuning
https://github.com/RWKV/RWKV-infctx-trainer Infctx trainer
World demo script: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_WORLD.py
Raven Q&A demo script: https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_more.py
!ChatRWKV-strategy
RWKV in 150 lines (model, inference, text generation): https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_in_150_lines.py
🔥 RWKV v5 in 250 lines 🔥 (with tokenizer too): https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
🔥 Building your own RWKV inference engine 🔥: begin with https://github.com/BlinkDL/ChatRWKV/blob/main/src/model_run.py which is easier to understand (used by https://Top issues
#15AMD Ubuntu 22.04 GPU - guide 7 comments · 2023-02-20#144RWKV 模型没有config.josn 文件吗?用text-generation-webui 报错5 comments · 2023-06-26#151很好的模型,但是4 comments · 2023-07-06#35[Feature request] 4bit/3bit quantization3 comments · 2023-03-14#202加速模型载入2 comments · 2024-07-18#198[pip package] Make loading aware that os.environ can change2 comments · 2024-03-17#194How to run new v5-Eagle-7B2 comments · 2024-02-02#179How to write the RWKV in autogressive style like RNN2 comments · 2023-10-11