跳到正文
TakoAPI
返回技能列表

hle-reasoning-wrapper

由 wanng-ide 提供

Health & Fitness
399下载量由 clawskills.sh 提供
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Wraps HLE benchmark questions in a structured Chain-of-Thought (CoT) reasoning process.

描述

该技能的功能

Wraps Humanity's Last Exam (HLE) benchmark questions in a Chain-of-Thought reasoning format. It injects a required Thought/Answer structure into prompts and validates that LLM responses comply with that format.

Handles both prompt formatting and output validation in one module, removing the need to manually enforce CoT structure on each HLE question.

何时使用

  • Evaluating LLM performance on HLE benchmark questions
  • Preprocessing HLE prompts before sending to a language model API
  • Validating that model outputs follow required CoT structure
  • Running automated HLE benchmark tests with format compliance checks
  • Debugging reasoning failures in structured LLM evaluations

示例工作流

输入

User asks: Answer this HLE question: What is the speed of light?

智能体
  1. 1

    Format the question using hle.formatPrompt() to inject the required Thought/Answer structure

  2. 2

    Send the formatted prompt to an LLM API

  3. 3

    Receive the raw LLM response

  4. 4

    Validate the response using hle.validateOutput() to check format compliance

输出

Validated response confirming the model followed the Thought/Answer reasoning structure

安装

clawhub install wanng-ide/hle-reasoning-wrapper

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接