Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

arxiv-gamedevbench-evaluating-agentic-capabili

bởi wanng-ide

Coding Agents & IDEs
443Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Learned from arXiv paper GameDevBench: Evaluating Agentic Capabilities Through Game Development.

Mô tả

Kỹ năng này làm gì

GameDevBench is a benchmark that evaluates AI agent capabilities using game development tasks, requiring agents to navigate large codebases while working with multimodal assets like shaders, sprites, and animations. This skill scaffolds Node.js experiments based on the paper's evaluation methodology.

Game development combines complex software engineering with multimodal assets, making it a more demanding evaluation testbed than pure coding benchmarks.

Khi nào nên dùng

  • Running GameDevBench evaluations on coding agents
  • Testing multimodal AI performance on game asset manipulation
  • Reproducing arXiv paper experiments locally
  • Comparing agent capabilities across game development tasks
  • Benchmarking agents on large codebase navigation

Quy trình ví dụ

ĐẦU VÀO

User asks: Run a GameDevBench evaluation experiment

AGENT
  1. 1

    Locate the base directory containing the benchmark scripts

  2. 2

    Configure experiment parameters for the target agent

  3. 3

    Execute node scripts/run.js to start the evaluation

  4. 4

    Collect and parse the benchmark output results

ĐẦU RA

Evaluation results showing agent performance on game development tasks

Cài đặt

clawhub install wanng-ide/arxiv-gamedevbench-evaluating-agentic-capabili

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết