- Update agent count from 18 to 19 (added qx-partner)
- Update skill count references to 41 (was inconsistent 37/38/39)
- Add Self-Learning System section to README explaining RL algorithms
- Add Why AQE? section with Problem-Solution table
- Remove outdated What's New and Roadmap sections from README
- Fix flaky detection accuracy claim from 100% to 90%+
- Remove unverified SWE-Bench and token reduction claims
- Add qx-partner to agents list in skills and manifest
- Update all user-facing docs with correct counts
- Add docs/PERFORMANCE.md for verified benchmarks
Files updated:
- README.md, CLAUDE.md, FUNDING.md
- docs/reference/{agents,skills,usage}.md
- .agentic-qe/docs/{agents,skills,usage}.md
- .claude/skills/agentic-quality-engineering/SKILL.md
- .claude/skills/cicd-pipeline-qe-orchestrator/README.md
- .claude/skills/skills-manifest.json
- src/cli/init/{agents,database-init}.ts
- src/telemetry/instrumentation/{agent,index}.ts
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
17 KiB
Agentic QE Fleet - Skills Reference
This document provides comprehensive reference for all 41 specialized QE skills available to agents.
Overview
QE skills are specialized knowledge modules that agents can invoke to enhance their capabilities. Skills are organized into phases and categories based on testing domains.
Phase 1: Original Quality Engineering Skills (18 skills)
Core Testing (3 skills)
agentic-quality-engineering
Using AI agents as force multipliers in quality work
Covers autonomous testing systems, PACT principles (Proactive, Autonomous, Collaborative, Targeted), and scaling quality engineering with intelligent agents.
Key Topics:
- AI-driven test generation
- Autonomous quality validation
- Agent coordination patterns
- Quality multiplier strategies
Usage:
Skill("agentic-quality-engineering")
context-driven-testing
Apply context-driven testing principles
Practices are chosen based on project context, not universal "best practices". Focuses on adapting testing approaches to specific situations.
Key Topics:
- Context analysis
- Heuristic testing
- Risk-based decisions
- Situational awareness
Usage:
Skill("context-driven-testing")
holistic-testing-pact
Holistic Testing Model evolved with PACT principles
Applies the Holistic Testing Model with Proactive, Autonomous, Collaborative, and Targeted principles for comprehensive quality coverage.
Key Topics:
- Quadrant-based testing
- Whole-team quality
- PACT evolution
- Agile testing strategies
Usage:
Skill("holistic-testing-pact")
Testing Methodologies (4 skills)
tdd-london-chicago
London and Chicago school TDD approaches
Understanding different TDD philosophies (inside-out vs outside-in) and choosing the right testing style for your context.
Key Topics:
- London School (mockist TDD)
- Chicago School (classicist TDD)
- When to use each approach
- Trade-offs and benefits
Usage:
Skill("tdd-london-chicago")
xp-practices
Extreme Programming practices
Apply XP practices including pair programming, ensemble programming, continuous integration, and sustainable pace.
Key Topics:
- Pair/Mob programming
- Continuous integration
- Refactoring discipline
- Test-first development
Usage:
Skill("xp-practices")
risk-based-testing
Focus testing on highest-risk areas
Use risk assessment and prioritization to allocate testing effort where it matters most.
Key Topics:
- Risk identification
- Risk matrix creation
- Prioritization strategies
- Coverage optimization
Usage:
Skill("risk-based-testing")
test-automation-strategy
Comprehensive test automation strategies
Design and implement effective test automation that balances coverage, maintenance, and execution speed.
Key Topics:
- Test pyramid/trophy
- Automation framework selection
- Maintenance strategies
- ROI optimization
Usage:
Skill("test-automation-strategy")
Testing Techniques (4 skills)
api-testing-patterns
Comprehensive API testing patterns
Contract testing, REST/GraphQL testing, and integration testing for APIs.
Key Topics:
- Contract testing (Pact)
- REST API testing
- GraphQL testing
- Authentication testing
Usage:
Skill("api-testing-patterns")
exploratory-testing-advanced
Advanced exploratory testing techniques
Session-Based Test Management (SBTM), RST heuristics, and test tours for structured exploration.
Key Topics:
- SBTM sessions
- RST heuristics
- Test tours
- Charter creation
Usage:
Skill("exploratory-testing-advanced")
performance-testing
Performance, scalability, and resilience testing
Load testing, stress testing, and performance optimization techniques.
Key Topics:
- Load testing patterns
- Stress testing
- Performance profiling
- SLA validation
Usage:
Skill("performance-testing")
security-testing
Security vulnerabilities using OWASP principles
Test for security vulnerabilities using OWASP principles and security testing techniques.
Key Topics:
- OWASP Top 10
- SAST/DAST
- Penetration testing
- Security compliance
Usage:
Skill("security-testing")
Code Quality (3 skills)
code-review-quality
Context-driven code reviews
Conduct effective code reviews focusing on quality, testability, and maintainability.
Key Topics:
- Review checklists
- Testability assessment
- Maintainability metrics
- Constructive feedback
Usage:
Skill("code-review-quality")
refactoring-patterns
Safe refactoring patterns
Apply safe refactoring patterns to improve code structure without changing behavior.
Key Topics:
- Refactoring catalog
- Test coverage first
- Incremental changes
- Design patterns
Usage:
Skill("refactoring-patterns")
quality-metrics
Measure quality effectively
Actionable metrics and KPIs for measuring and improving software quality.
Key Topics:
- Metric selection
- Dashboard design
- Trend analysis
- Leading indicators
Usage:
Skill("quality-metrics")
Communication (3 skills)
bug-reporting-excellence
High-quality bug reports
Write bug reports that get fixed quickly with templates, examples, and best practices.
Key Topics:
- Bug report structure
- Reproducibility
- Severity assessment
- Clear communication
Usage:
Skill("bug-reporting-excellence")
technical-writing
Clear, concise technical documentation
Create effective technical documentation that practitioners actually want to read.
Key Topics:
- Documentation structure
- Audience awareness
- Code examples
- Maintenance strategies
Usage:
Skill("technical-writing")
consultancy-practices
Software quality consultancy
Effective consulting practices for quality engineering engagements.
Key Topics:
- Client engagement
- Assessment frameworks
- Recommendation strategies
- Change management
Usage:
Skill("consultancy-practices")
Phase 2: Expanded QE Skills Library (16 skills)
Testing Methodologies (6 skills)
regression-testing
Strategic regression testing
Test selection, impact analysis, and continuous regression management.
Key Topics:
- Test selection algorithms
- Impact analysis
- Risk-based regression
- Continuous regression
Usage:
Skill("regression-testing")
shift-left-testing
Move testing earlier in development
TDD, BDD, and design for testability to catch bugs earlier.
Key Topics:
- Unit testing discipline
- TDD/BDD practices
- Testability patterns
- Early quality gates
Usage:
Skill("shift-left-testing")
shift-right-testing
Testing in production
Feature flags, canary deployments, synthetic monitoring, and chaos engineering.
Key Topics:
- Feature flags
- Canary deployments
- Synthetic monitoring
- Production testing
Usage:
Skill("shift-right-testing")
test-design-techniques
Advanced test design
Equivalence partitioning, boundary value analysis, and decision tables.
Key Topics:
- Test design methods
- Combinatorial testing
- Pairwise testing
- Decision tables
Usage:
Skill("test-design-techniques")
mutation-testing
Test quality validation
Measure test suite effectiveness through mutation testing.
Key Topics:
- Mutation operators
- Kill rate analysis
- Coverage vs quality
- Tool integration
Usage:
Skill("mutation-testing")
test-data-management
Realistic test data generation
GDPR compliance and data masking strategies.
Key Topics:
- Data generation
- GDPR compliance
- Data masking
- Synthetic data
Usage:
Skill("test-data-management")
Specialized Testing (9 skills)
accessibility-testing
WCAG 2.2 compliance testing
Screen reader validation and inclusive design verification.
Key Topics:
- WCAG 2.2 criteria
- Screen reader testing
- Keyboard navigation
- Color contrast
Usage:
Skill("accessibility-testing")
mobile-testing
Comprehensive mobile testing
iOS and Android testing including gestures, sensors, and device fragmentation.
Key Topics:
- Device fragmentation
- Touch gestures
- Sensor testing
- Platform-specific testing
Usage:
Skill("mobile-testing")
database-testing
Database schema validation
Data integrity testing, migration testing, and query performance.
Key Topics:
- Schema validation
- Data integrity
- Migration testing
- Performance tuning
Usage:
Skill("database-testing")
contract-testing
Consumer-driven contract testing
Microservices testing using Pact and API versioning.
Key Topics:
- Pact framework
- Contract validation
- Versioning strategies
- Provider verification
Usage:
Skill("contract-testing")
chaos-engineering-resilience
Chaos engineering principles
Controlled failure injection and resilience testing.
Key Topics:
- Fault injection
- Resilience patterns
- Blast radius
- Recovery testing
Usage:
Skill("chaos-engineering-resilience")
compatibility-testing
Cross-browser, cross-platform testing
Cross-device compatibility testing ensuring consistent experience.
Key Topics:
- Browser testing
- Platform compatibility
- Responsive design
- Progressive enhancement
Usage:
Skill("compatibility-testing")
localization-testing
Internationalization (i18n) and localization (l10n)
Testing for global products including translations and locale formats.
Key Topics:
- i18n testing
- Translation validation
- Locale formats
- RTL languages
Usage:
Skill("localization-testing")
compliance-testing
Regulatory compliance testing
GDPR, CCPA, HIPAA, SOC2, and PCI-DSS validation.
Key Topics:
- GDPR compliance
- HIPAA validation
- SOC2 requirements
- PCI-DSS testing
Usage:
Skill("compliance-testing")
visual-testing-advanced
Advanced visual regression testing
AI-powered screenshot comparison and UI validation.
Key Topics:
- Visual regression
- AI comparison
- Layout validation
- Responsive testing
Usage:
Skill("visual-testing-advanced")
Testing Infrastructure (2 skills)
test-environment-management
Manage test environments
Infrastructure as code and environment provisioning.
Key Topics:
- IaC patterns
- Environment isolation
- Data management
- Configuration management
Usage:
Skill("test-environment-management")
test-reporting-analytics
Comprehensive test reporting
Metrics, trends, and actionable insights from test data.
Key Topics:
- Report generation
- Trend analysis
- Metrics dashboards
- Actionable insights
Usage:
Skill("test-reporting-analytics")
Phase 3: Advanced Quality Engineering Skills (4 skills)
Strategic Testing Methodologies (4 skills)
six-thinking-hats
Edward de Bono's Six Thinking Hats for comprehensive testing analysis
Apply Six Thinking Hats methodology to software testing for structured exploration from six perspectives: facts (White), risks (Black), benefits (Yellow), creativity (Green), emotions (Red), and process (Blue).
Key Topics:
- Test strategy design
- Test retrospectives
- Failure analysis
- Multi-perspective evaluation
Usage:
Skill("six-thinking-hats")
Use Cases:
- Designing test strategies
- Conducting test retrospectives
- Analyzing test failures
- Evaluating testing approaches
- Facilitating testing discussions
brutal-honesty-review
Unvarnished technical criticism for code and test quality
Brutally honest technical reviews combining Linus Torvalds' precision, Gordon Ramsay's standards, and James Bach's BS-detection. No sugar-coating, just surgical truth about what's broken and why.
Key Topics:
- Technical precision
- Quality standards
- BS detection
- Certification skepticism
Usage:
Skill("brutal-honesty-review")
Use Cases:
- Code/test reality checks
- Identifying technical debt
- Challenging questionable practices
- Evaluating certifications/training
- Senior-level technical reviews
sherlock-review
Evidence-based investigative code review using deductive reasoning
Conducts methodical, evidence-based investigation of code, tests, and system behavior using Holmesian deductive reasoning. Investigates what actually happened versus what was claimed, seeing what others miss through systematic observation.
Key Topics:
- Evidence collection
- Deductive reasoning
- Claims verification
- Root cause investigation
- Systematic observation
Usage:
Skill("sherlock-review")
Use Cases:
- Verifying implementation claims
- Investigating bugs and fixes
- Validating performance claims
- Conducting root cause analysis
- Evidence-based code review
cicd-pipeline-qe-orchestrator
Comprehensive quality orchestration across CI/CD pipeline phases
Intelligently select QE skills and coordinate specialized agents for holistic quality coverage throughout the software delivery lifecycle. Integrates all 41 AQE skills and 19 agents.
Key Topics:
- Pipeline phase analysis
- Skill selection strategies
- Agent orchestration
- Shift-left/shift-right testing
- Quality gates
Usage:
Skill("cicd-pipeline-qe-orchestrator")
Use Cases:
- Designing test strategies for CI/CD
- Planning quality gates per phase
- Implementing shift-left testing
- Implementing shift-right testing
- Holistic pipeline quality coverage
- Microservice pipeline testing
- Monolith pipeline testing
- Mobile app pipeline testing
Phase 4: Community Contributed Skills (1 skill)
Testability Assessment
testability-scoring
Automated testability assessment using 10 principles of intrinsic testability
Evaluates software testability through automated analysis of 10 intrinsic principles, providing actionable scores (0-100) with letter grades, AI-powered recommendations, and visual HTML reports with Chart.js radar visualizations.
Contributed by @fndlalit - Based on testability-scorer
Key Topics:
- Observability & Controllability assessment
- Algorithmic simplicity & transparency
- Explainability & similarity analysis
- Stability & unbugginess metrics
- Smallness & decomposability evaluation
- HTML reports with radar charts
- AI-powered improvement recommendations
The 10 Principles:
- Observability (15%) - State transparency and monitoring
- Controllability (15%) - State manipulation and test data injection
- Algorithmic Simplicity (10%) - Clear input-output relationships
- Algorithmic Transparency (10%) - Understandable logic flow
- Explainability (10%) - Documentation and clarity
- Similarity (5%) - Standard patterns and familiar architecture
- Algorithmic Stability (10%) - API versioning and compatibility
- Unbugginess (10%) - Low defect rate
- Smallness (10%) - Manageable size and modularity
- Decomposability (5%) - Component isolation
Usage:
Skill("testability-scoring")
Quick Start:
# Run full assessment (10 principles)
.claude/skills/testability-scoring/scripts/run-assessment.sh https://your-app.com chromium
# Generate HTML report from JSON
AUTO_OPEN=false node .claude/skills/testability-scoring/scripts/generate-html-report.js tests/reports/testability-results-*.json
Use Cases:
- Assessing application testability before test automation
- Identifying testability gaps and improvements
- Generating visual testability reports
- Tracking testability improvements over time
- CI/CD quality gate integration
Scoring Scale:
- A (90-100): Excellent testability
- B (80-89): Good testability
- C (70-79): Acceptable testability
- D (60-69): Below average
- F (0-59): Poor testability
Using Skills
Via CLI
# List all available skills
aqe skills list
# Search for specific skills
aqe skills search "testing"
# Show skill details
aqe skills show agentic-quality-engineering
# Show skill statistics
aqe skills stats
Via Skill Tool in Claude Code
// Execute a skill
Skill("agentic-quality-engineering")
Skill("tdd-london-chicago")
Skill("api-testing-patterns")
Integration with Agents
All QE agents automatically have access to relevant skills based on their specialization:
- Test generators use: agentic-quality-engineering, api-testing-patterns, tdd-london-chicago
- Coverage analyzers use: agentic-quality-engineering, quality-metrics, risk-based-testing
- Flaky test hunters use: agentic-quality-engineering, exploratory-testing-advanced
- Performance testers use: agentic-quality-engineering, performance-testing, quality-metrics
- Security scanners use: agentic-quality-engineering, security-testing, risk-based-testing
Related Documentation:
- Agent Reference - All 19 QE agents
- Usage Guide - Complete usage examples
Related Policies: