Skill Tester
Skill Tester is a meta-skill that validates, tests, and scores the quality of skills in the claude-skills ecosystem. It provides four Python scripts to check structure, test Python scripts, score quality, and assess security, producing JSON reports with scores, letter grades, and improvement roadmaps.
✨ What it does
- Validates SKILL.md frontmatter, required sections, and directory structure against tier-specific requirements.
- Tests Python scripts for syntax, imports, runtime behavior, and output format with timeout protection.
- Scores quality across four dimensions (Documentation, Code Quality, Completeness, Usability) to produce a 0-100 score an
- Provides tier recommendations and an improvement roadmap to guide fixes.
- Supports JSON output and minimum-score thresholds for CI integration.
- Includes a security scoring option for assessing security posture.
🎯 When to use it
- When authoring a new skill and you need to validate its structure and test its scripts.
- When auditing existing skills to determine if they qualify for a higher tier (BASIC/STANDARD/POWERFUL).
- When setting up pre-commit hooks or CI pipelines to enforce skill quality gates.
🚀 How to use
Run the scripts from the repository root with full paths to the skill directory. Use the slash command or invoke the scripts directly. Provide the skill path and optional flags like --json, --detailed, --minimum-score, or --timeout. Example prompts:
python3 engineering/skills/skill-tester/scripts/skill_validator.py engineering/skills/self-eval --json
python3 engineering/skills/skill-tester/scripts/script_tester.py engineering/skills/self-eval --json
python3 engineering/skills/skill-tester/scripts/quality_scorer.py engineering/skills/self-eval --json --detailed --minimum-score 75
📄 Output: JSON reports from each script, including validation results, test outcomes, quality scores with letter grades, and improvement roadmaps.
📦 Add this skill to Claude Code
# 1. Get the skills repo
git clone --depth 1 https://github.com/alirezarezvani/claude-skills /tmp/claude-skills
# 2. Copy this skill into your project (or ~/.claude/skills for all projects)
mkdir -p .claude/skills
cp -r /tmp/claude-skills/engineering/skills/skill-tester .claude/skills/skill-testerSkill source: engineering/skills/skill-tester/SKILL.md
⚠️ Good to know
The tier line-count minimums apply to legacy skills; for new skills, the write-a-skill standard (SKILL.md under ~100 lines) is binding, and scripts must use only Python stdlib (no external dependencies).
❓ FAQ
What does the quality scorer output?
It outputs an overall score (0-100), a letter grade (A-F), a tier recommendation, dimension scores, and an improvement roadmap.
How can I use Skill Tester in CI?
Run the validator, script tester, and quality scorer on changed skills, and use the --minimum-score flag to fail the build if the score is below the threshold.
What should I do if a script times out?
Increase the timeout using the --timeout flag or optimize the script under test.
🤖 Overview, features, install steps and FAQ were generated from the project's SKILL.md on Sep 4, 2026. Always check the original source before running commands.