Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

hle-benchmark-evolver

bởi wanng-ide

Browser & Automation
434Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Runs HLE-oriented benchmark reward ingestion and curriculum generation for capability-evolver.

Mô tả

Kỹ năng này làm gì

Ingests question-level HLE benchmark results into the capability-evolver reward system and generates curriculum signals for evolution cycles. Converts per-question accuracy data into prioritized queues that focus subsequent training on easier questions first.

Closes the loop between benchmark evaluation and capability evolution by automating reward ingestion, curriculum prioritization, and solidification in a single pipeline command.

Khi nào nên dùng

  • Processing an HLE report JSON into reward and curriculum signals
  • Running a multi-cycle evolution pipeline with automatic re-evaluation
  • Checking current benchmark accuracy and curriculum stage snapshot
  • Targeting a specific HLE score threshold using easy-first question queues
  • Identifying which subjects and modalities to focus on next

Quy trình ví dụ

ĐẦU VÀO

User asks: ingest my HLE report and generate curriculum signals

AGENT
  1. 1

    Validate the report JSON exists at the provided path

  2. 2

    Ingest report into capability-evolver benchmark reward state

  3. 3

    Generate curriculum signals: benchmark_*, curriculum_stage:*, focus_subject:*, question_focus:*

  4. 4

    Print compact result summary as JSON

ĐẦU RA

JSON with benchmark_id, accuracy, reward, trend, curriculum_stage, queue_size, focus_subjects, and next_questions

Cài đặt

clawhub install wanng-ide/hle-benchmark-evolver

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết