本文へスキップ
TakoAPI
スキル一覧に戻る

pinchbench

olearycrew 作

Coding Agents & IDEs
439ダウンロード数はclawskills.shが公開している値です
0閲覧数
0件のいいねサインインするとこのスキルにいいねできます
—まだ評価がありません
あなたの評価

概要

Run PinchBench benchmarks to evaluate OpenClaw agent performance across real-world tasks.

説明

このスキルでできること

PinchBench measures LLM model performance as the brain of an OpenClaw agent across 23 standardized tasks. Tasks span calendar, email, research, coding, file management, and multi-step workflows. Results are graded automatically and can be submitted to a public leaderboard at pinchbench.com.

Provides 23 reproducible, auto-graded tasks with a public leaderboard, making model comparisons objective rather than anecdotal.

使いどころ

  • Comparing two models on email triage and calendar tasks before picking one
  • Running the automated-only suite for a quick performance check before a release
  • Submitting benchmark scores to the PinchBench public leaderboard
  • Testing a specific subset of tasks like market research or PDF summarization
  • Verifying a new OpenClaw setup handles multi-step API workflows correctly

ワークフロー例

入力

User asks: How well does claude-sonnet-4 handle email and calendar tasks?

エージェント
  1. 1

    Register for a PinchBench API token using the --register flag

  2. 2

    Run the benchmark targeting specific tasks: --suite task_01_calendar,task_16_email_triage,task_17_email_search

  3. 3

    Wait for tasks to complete and results to save as JSON in the results/ directory

  4. 4

    Inspect scores with jq to extract per-task grading means

  5. 5

    Results upload automatically to the leaderboard using the registered token

出力

Per-task scores for calendar and email tasks, plus an overall average, visible on the pinchbench.com leaderboard

要件

  • PinchBench API token for leaderboard submission (register once via --register flag)

インストール

clawhub install olearycrew/pinchbench

CLIコマンドを実行するか、Claude Code、Cursor、Codexなどお使いのコーディングエージェントにプロンプトを貼り付けてください。

リンク