本文へスキップ
TakoAPI
スキル一覧に戻る

hle-benchmark-evolver

wanng-ide 作

Browser & Automation
434ダウンロード数はclawskills.shが公開している値です
0閲覧数
0件のいいねサインインするとこのスキルにいいねできます
—まだ評価がありません
あなたの評価

概要

Runs HLE-oriented benchmark reward ingestion and curriculum generation for capability-evolver.

説明

このスキルでできること

Ingests question-level HLE benchmark results into the capability-evolver reward system and generates curriculum signals for evolution cycles. Converts per-question accuracy data into prioritized queues that focus subsequent training on easier questions first.

Closes the loop between benchmark evaluation and capability evolution by automating reward ingestion, curriculum prioritization, and solidification in a single pipeline command.

使いどころ

  • Processing an HLE report JSON into reward and curriculum signals
  • Running a multi-cycle evolution pipeline with automatic re-evaluation
  • Checking current benchmark accuracy and curriculum stage snapshot
  • Targeting a specific HLE score threshold using easy-first question queues
  • Identifying which subjects and modalities to focus on next

ワークフロー例

入力

User asks: ingest my HLE report and generate curriculum signals

エージェント
  1. 1

    Validate the report JSON exists at the provided path

  2. 2

    Ingest report into capability-evolver benchmark reward state

  3. 3

    Generate curriculum signals: benchmark_*, curriculum_stage:*, focus_subject:*, question_focus:*

  4. 4

    Print compact result summary as JSON

出力

JSON with benchmark_id, accuracy, reward, trend, curriculum_stage, queue_size, focus_subjects, and next_questions

インストール

clawhub install wanng-ide/hle-benchmark-evolver

CLIコマンドを実行するか、Claude Code、Cursor、Codexなどお使いのコーディングエージェントにプロンプトを貼り付けてください。

リンク