Saltar al contenido
TakoAPI
Volver a skills

arxiv-gamedevbench-evaluating-agentic-capabili

por wanng-ide

Coding Agents & IDEs
443Descargas según clawskills.sh
0Vistas
0 me gustaInicia sesión para dar me gusta a esta skill
—Aún sin valoraciones
Tu valoración

Resumen

Learned from arXiv paper GameDevBench: Evaluating Agentic Capabilities Through Game Development.

Descripción

Qué hace esta skill

GameDevBench is a benchmark that evaluates AI agent capabilities using game development tasks, requiring agents to navigate large codebases while working with multimodal assets like shaders, sprites, and animations. This skill scaffolds Node.js experiments based on the paper's evaluation methodology.

Game development combines complex software engineering with multimodal assets, making it a more demanding evaluation testbed than pure coding benchmarks.

Cuándo usarla

  • Running GameDevBench evaluations on coding agents
  • Testing multimodal AI performance on game asset manipulation
  • Reproducing arXiv paper experiments locally
  • Comparing agent capabilities across game development tasks
  • Benchmarking agents on large codebase navigation

Flujo de trabajo de ejemplo

ENTRADA

User asks: Run a GameDevBench evaluation experiment

AGENTE
  1. 1

    Locate the base directory containing the benchmark scripts

  2. 2

    Configure experiment parameters for the target agent

  3. 3

    Execute node scripts/run.js to start the evaluation

  4. 4

    Collect and parse the benchmark output results

SALIDA

Evaluation results showing agent performance on game development tasks

Instalación

clawhub install wanng-ide/arxiv-gamedevbench-evaluating-agentic-capabili

Ejecuta el comando de la CLI o pega el prompt en Claude Code, Cursor, Codex o el agente de programación que uses.

Enlaces