部署与运维

rwkv-architecture

Name: rwkv-architecture
Author: orchestra-research

orchestra-research/ai-research-skills

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.

960 次安装
1.4万星标
收录于 2026.01.21

安装命令

$ npx skills add https://github.com/orchestra-research/ai-research-skills --skill rwkv-architecture

SKILL.md

RWKV - Receptance Weighted Key Value

Quick start

RWKV (RwaKuv) combines Transformer parallelization (training) with RNN efficiency (inference).

Installation:

# Install PyTorch
pip install torch --upgrade --extra-index-url https://download.pytorch.org/whl/cu121

# Install dependencies
pip install pytorch-lightning==1.9.5 deepspeed wandb ninja --upgrade

# Install RWKV
pip install rwkv

SKILL.md

RWKV - Receptance Weighted Key Value

Quick start

相关 Skills