数据与研究

cost-trend

ruvnet/ruflo

Read every docs/benchmarks/runs/*.json and surface drift in win rate, latency, escalation rate, and LLM-baseline cost over time

  • 683 次安装
  • 8万 星标
  • 收录于

安装命令

npx skills add https://github.com/ruvnet/ruflo --skill cost-trend

SKILL.md

Cost Trend

The smoke gate is binary (winRate ≥ 0.80 → pass/fail). The corpus benchmarks captured over time form a curve — and curves catch regressions the gate misses (win rate slowly creeping from 100% to 85% is "still passing" by smoke but a real degradation).

This skill reads every persisted run in docs/benchmarks/runs/*.json and reports first→last deltas plus a per-run series, flagging regressions in win rate or latency.

When to use

  • Before a release — check that the speedup hasn't drifted.
  • After expanding the corpus — verify older runs still hit the same win rate on the new corpus they reflected.
  • After upgrading agent-booster — surface latency / strategy changes.

Steps

  1. Run the trend script from the project root:

    node plugins/ruflo-cost-tracker/scripts/trend.mjs