कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

skillbench

g9pedro द्वारा

Git & GitHub
973clawskills.sh द्वारा बताए गए डाउनलोड
0व्यूज़
0 लाइकइस स्किल को लाइक करने के लिए साइन इन करें
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Track skill versions, benchmark performance, compare improvements, and get self-improvement signals.

विवरण

यह स्किल क्या करती है

skillbench is a CLI tool for tracking AI agent skill performance across versions. It records task outcomes, scores skills on a graded scale, and surfaces which skills are declining, stale, or need attention. Benchmarks can be collected manually or pulled automatically from tasktime.

Combines version-aware benchmarking, graded scoring, regression detection, and improvement suggestions in one tool built around the AI agent skill workflow rather than general software testing.

इसे कब इस्तेमाल करें

  • Comparing a skill's success rate before and after an update
  • Flagging which skills have dropped below 70% success rate
  • Auto-recording task duration via tasktime integration without manual timing
  • Running baseline checks in CI to catch skill regressions
  • Generating a performance dashboard to review agent health across all skills

उदाहरण वर्कफ़्लो

इनपुट

User asks: Check if my github skill improved after updating it to v1.1.0

एजेंट
  1. 1

    Sets active version with skillbench use github@1.1.0

  2. 2

    Records a task outcome after completing work: skillbench record "Create PR" --success

  3. 3

    Runs a version comparison: skillbench compare github@1.0.0 github@1.1.0

  4. 4

    Reviews the score breakdown across success rate, duration, consistency, and trend

  5. 5

    Checks improvement suggestions with skillbench improve github if grade is still low

आउटपुट

Side-by-side grade comparison showing whether v1.1.0 improved or regressed across each scoring dimension

इंस्टॉलेशन

clawhub install g9pedro/skillbench

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक