skillbench
bởi g9pedro
Git & GitHubTóm tắt
Track skill versions, benchmark performance, compare improvements, and get self-improvement signals.
Mô tả
Kỹ năng này làm gì
skillbench is a CLI tool for tracking AI agent skill performance across versions. It records task outcomes, scores skills on a graded scale, and surfaces which skills are declining, stale, or need attention. Benchmarks can be collected manually or pulled automatically from tasktime.
Combines version-aware benchmarking, graded scoring, regression detection, and improvement suggestions in one tool built around the AI agent skill workflow rather than general software testing.
Khi nào nên dùng
- Comparing a skill's success rate before and after an update
- Flagging which skills have dropped below 70% success rate
- Auto-recording task duration via tasktime integration without manual timing
- Running baseline checks in CI to catch skill regressions
- Generating a performance dashboard to review agent health across all skills
Quy trình ví dụ
User asks: Check if my github skill improved after updating it to v1.1.0
- 1
Sets active version with
skillbench use github@1.1.0 - 2
Records a task outcome after completing work:
skillbench record "Create PR" --success - 3
Runs a version comparison:
skillbench compare github@1.0.0 github@1.1.0 - 4
Reviews the score breakdown across success rate, duration, consistency, and trend
- 5
Checks improvement suggestions with
skillbench improve githubif grade is still low
Side-by-side grade comparison showing whether v1.1.0 improved or regressed across each scoring dimension
Cài đặt
clawhub install g9pedro/skillbenchChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.