Improve dotnet-test eval power and resilience (#989)

* Improve dotnet-test eval coverage and efficiency

Address remaining high-confidence items from #899 by bounding the code-testing pipeline and adding eval coverage for grade-tests and find-untested-sources.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: e430fee9-d3df-4ef5-85a4-745ae4b17046

* Fix dotnet-test eval activation and quality

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 9c5c1a52-4f99-49d6-b503-1bec713a6e98

* Strengthen dotnet-test skill activation

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 9c5c1a52-4f99-49d6-b503-1bec713a6e98

* Improve dotnet-test eval signal and resilience

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Address eval review findings

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Remove non-measuring smell eval trials

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Fail evaluation on unexpected adapter errors

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Stabilize assertion quality evidence

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Strengthen assertion quality routing

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

* Treat adapter SIGKILL as failure

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a

---------

Copilot-Session: e430fee9-d3df-4ef5-85a4-745ae4b17046
Copilot-Session: 9c5c1a52-4f99-49d6-b503-1bec713a6e98
Copilot-Session: a492694c-6e0f-4af4-8b5e-18331568499a
This commit is contained in:
Amaury Levé
2026-08-05 17:06:52 +02:00
committed by GitHub
parent d94c40450e
commit 69fe56a74f
8 changed files with 148 additions and 142 deletions
@@ -1,6 +1,6 @@
---
name: assertion-quality
description: "Analyzes the variety and depth of assertions across test suites in any language. Use when the user asks to evaluate assertion quality, find shallow tests, identify assertion-free tests (no assertions or only trivial ones like Assert.IsNotNull / toBeTruthy()), flag self-referential or tautological assertions, measure assertion diversity, or audit whether tests verify different facets of behavior. Polyglot: .NET, Python, TS/JS, Java, Go, Ruby, Rust, Swift, Kotlin, PowerShell, C++. DO NOT USE FOR: writing new tests (use code-testing-agent / writing-mstest-tests), mutation reasoning about whether tests would catch a bug (use test-gap-analysis), or a general severity-ranked anti-pattern audit (use test-anti-patterns), fixing or rewriting assertions, or writing, fixing, or modernizing MSTest tests, assertions, or attributes (use writing-mstest-tests)."
description: "MANDATORY for reviewing assertion strength, depth, and variety in existing tests. Invoke when the user asks whether individual assertions are weak, shallow, trivial, always true, self-referential, or diverse; asks which tests are assertion-free or rely only on presence/truthiness checks; or requests assertion quality/depth/variety metrics. Polyglot: .NET, Python/pytest, TS/JS/Jest, Java, Go, Ruby, Rust, Swift, Kotlin, PowerShell, C++. DO NOT USE FOR: writing or fixing tests/assertions (use code-testing-agent or writing-mstest-tests), mutation reasoning (use test-gap-analysis), or a general severity-ranked anti-pattern audit (use test-anti-patterns)."
license: MIT
---