Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

hle-reasoning-wrapper

bởi wanng-ide

Health & Fitness
399Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Wraps HLE benchmark questions in a structured Chain-of-Thought (CoT) reasoning process.

Mô tả

Kỹ năng này làm gì

Wraps Humanity's Last Exam (HLE) benchmark questions in a Chain-of-Thought reasoning format. It injects a required Thought/Answer structure into prompts and validates that LLM responses comply with that format.

Handles both prompt formatting and output validation in one module, removing the need to manually enforce CoT structure on each HLE question.

Khi nào nên dùng

  • Evaluating LLM performance on HLE benchmark questions
  • Preprocessing HLE prompts before sending to a language model API
  • Validating that model outputs follow required CoT structure
  • Running automated HLE benchmark tests with format compliance checks
  • Debugging reasoning failures in structured LLM evaluations

Quy trình ví dụ

ĐẦU VÀO

User asks: Answer this HLE question: What is the speed of light?

AGENT
  1. 1

    Format the question using hle.formatPrompt() to inject the required Thought/Answer structure

  2. 2

    Send the formatted prompt to an LLM API

  3. 3

    Receive the raw LLM response

  4. 4

    Validate the response using hle.validateOutput() to check format compliance

ĐẦU RA

Validated response confirming the model followed the Thought/Answer reasoning structure

Cài đặt

clawhub install wanng-ide/hle-reasoning-wrapper

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết