跳到正文
TakoAPI
返回技能列表

arxiv-gamedevbench-evaluating-agentic-capabili

由 wanng-ide 提供

Coding Agents & IDEs
443下载量由 clawskills.sh 提供
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Learned from arXiv paper GameDevBench: Evaluating Agentic Capabilities Through Game Development.

描述

该技能的功能

GameDevBench is a benchmark that evaluates AI agent capabilities using game development tasks, requiring agents to navigate large codebases while working with multimodal assets like shaders, sprites, and animations. This skill scaffolds Node.js experiments based on the paper's evaluation methodology.

Game development combines complex software engineering with multimodal assets, making it a more demanding evaluation testbed than pure coding benchmarks.

何时使用

  • Running GameDevBench evaluations on coding agents
  • Testing multimodal AI performance on game asset manipulation
  • Reproducing arXiv paper experiments locally
  • Comparing agent capabilities across game development tasks
  • Benchmarking agents on large codebase navigation

示例工作流

输入

User asks: Run a GameDevBench evaluation experiment

智能体
  1. 1

    Locate the base directory containing the benchmark scripts

  2. 2

    Configure experiment parameters for the target agent

  3. 3

    Execute node scripts/run.js to start the evaluation

  4. 4

    Collect and parse the benchmark output results

输出

Evaluation results showing agent performance on game development tasks

安装

clawhub install wanng-ide/arxiv-gamedevbench-evaluating-agentic-capabili

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接