본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

hollow-validation-checker

andyxinweiminicloud 제작

Coding Agents & IDEs
349clawskills.sh가 보고한 다운로드 수
1조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Helps detect hollow validation in AI agent skills — identifies fake tests that always pass without actually.

설명

이 스킬이 하는 일

Analyzes validation commands and test code in AI agent skills to identify patterns that fake quality signals. Detects exit code gaming, echo-only commands, tautological assertions, and commented-out tests. Rates each validation as SUBSTANTIVE, WEAK, or HOLLOW.

Manual code review can miss sophisticated test theater where real frameworks are invoked but assertions test trivially true conditions, which this tool flags through static analysis of assertion content.

사용 시점

  • Auditing agent marketplace skills before adding them to a production pipeline
  • Reviewing community-submitted skills before merging a PR
  • Comparing validation quality across a batch of published skills
  • Flagging skills that claim test coverage but run no real assertions
  • Deciding whether to trust a skill's published validation rating

예시 워크플로

입력

User asks: Check this Capsule JSON — its validation field claims 14 tests passed

에이전트
  1. 1

    Parse the validation field from the provided Capsule JSON

  2. 2

    Break down each command in the validation chain

  3. 3

    Check each command for real assertion statements vs hardcoded success strings

  4. 4

    Inventory real assertions vs hollow outputs

  5. 5

    Generate a quality rating with evidence

출력

HOLLOW rating: 0 real assertions found, 2 hollow outputs (hardcoded print statement claiming 14 tests, static echo). Recommendation to treat as unvalidated.

설치

clawhub install andyxinweiminicloud/hollow-validation-checker

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크