본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

hle-benchmark-evolver

wanng-ide 제작

Browser & Automation
434clawskills.sh가 보고한 다운로드 수
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Runs HLE-oriented benchmark reward ingestion and curriculum generation for capability-evolver.

설명

이 스킬이 하는 일

Ingests question-level HLE benchmark results into the capability-evolver reward system and generates curriculum signals for evolution cycles. Converts per-question accuracy data into prioritized queues that focus subsequent training on easier questions first.

Closes the loop between benchmark evaluation and capability evolution by automating reward ingestion, curriculum prioritization, and solidification in a single pipeline command.

사용 시점

  • Processing an HLE report JSON into reward and curriculum signals
  • Running a multi-cycle evolution pipeline with automatic re-evaluation
  • Checking current benchmark accuracy and curriculum stage snapshot
  • Targeting a specific HLE score threshold using easy-first question queues
  • Identifying which subjects and modalities to focus on next

예시 워크플로

입력

User asks: ingest my HLE report and generate curriculum signals

에이전트
  1. 1

    Validate the report JSON exists at the provided path

  2. 2

    Ingest report into capability-evolver benchmark reward state

  3. 3

    Generate curriculum signals: benchmark_*, curriculum_stage:*, focus_subject:*, question_focus:*

  4. 4

    Print compact result summary as JSON

출력

JSON with benchmark_id, accuracy, reward, trend, curriculum_stage, queue_size, focus_subjects, and next_questions

설치

clawhub install wanng-ide/hle-benchmark-evolver

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크