arxiv-agentic-verifier
bởi wanng-ide
Coding Agents & IDEsTóm tắt
**Source Paper:** [Scaling Agentic Verifier for Competitive Coding](https://arxiv.org/abs/2602.09012) (ID.
Mô tả
Kỹ năng này làm gì
An agentic verifier that checks code correctness by generating targeted test cases designed to expose logic flaws. It analyzes problem constraints and code structure to produce discriminative inputs rather than sampling randomly. Supports Python and JavaScript.
Generates discriminative test cases from problem analysis rather than random inputs, catching logic flaws that fuzzing and random sampling routinely miss.
Khi nào nên dùng
- Verifying competitive programming submissions before upload
- Finding edge cases in coding interview solutions
- Catching off-by-one errors in algorithmic implementations
- Checking boundary behavior in math or sorting functions
- Automated validation of student code against problem specs
Quy trình ví dụ
User asks: verify this Python solution for a two-integer sum problem
- 1
Parse the problem description to extract constraints and expected behavior
- 2
Analyze the submitted code's logic and input-handling structure
- 3
Generate targeted test cases aimed at boundary conditions and likely failure modes
- 4
Execute the code against each generated test in a sandboxed environment
- 5
Collect and report pass/fail results with the specific inputs that caused failures
Verification report listing which tests passed, which failed, and the exact inputs that broke the code
Yêu cầu
- OPENAI_API_KEY environment variable
Cài đặt
clawhub install wanng-ide/arxiv-agentic-verifierChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.