arxiv-gamedevbench-evaluating-agentic-capabili
von wanng-ide
Coding Agents & IDEsKurzbeschreibung
Learned from arXiv paper GameDevBench: Evaluating Agentic Capabilities Through Game Development.
Beschreibung
Was dieser Skill macht
GameDevBench is a benchmark that evaluates AI agent capabilities using game development tasks, requiring agents to navigate large codebases while working with multimodal assets like shaders, sprites, and animations. This skill scaffolds Node.js experiments based on the paper's evaluation methodology.
Game development combines complex software engineering with multimodal assets, making it a more demanding evaluation testbed than pure coding benchmarks.
Wann du ihn einsetzt
- Running GameDevBench evaluations on coding agents
- Testing multimodal AI performance on game asset manipulation
- Reproducing arXiv paper experiments locally
- Comparing agent capabilities across game development tasks
- Benchmarking agents on large codebase navigation
Beispiel-Workflow
User asks: Run a GameDevBench evaluation experiment
- 1
Locate the base directory containing the benchmark scripts
- 2
Configure experiment parameters for the target agent
- 3
Execute node scripts/run.js to start the evaluation
- 4
Collect and parse the benchmark output results
Evaluation results showing agent performance on game development tasks
Installation
clawhub install wanng-ide/arxiv-gamedevbench-evaluating-agentic-capabiliFühre den CLI-Befehl aus oder füge den Prompt in Claude Code, Cursor, Codex oder deinen Coding-Agenten ein.