markharness

0005: Usefulness triage and rejected items from the 2026-08-13 evaluation review

Status

Accepted. Triage of the findings is complete, and there are no further changes to follow (if this triage is ever overturned, this ADR should be marked Superseded and a new ADR with a new number should be started).

Background

For テスト知識管理のGit-nativeモデル_評価レビュー.md (2026-08-13 edition, a revised version re-evaluating the response status to the initial 2026-08-12 review), each finding was judged as useful/not useful in テスト知識管理のGit-nativeモデル_評価レビュー_有用性判定と修正指示.md. The judgment criterion had two axes: whether it directly improves the accuracy/reliability/usability of the markharness tool’s functionality, behavior, or documentation (useful), or whether it only serves to satisfy a reviewer (defending novelty, the form of an empirical study) without changing the tool itself (not useful). “Not useful” does not mean the finding is factually wrong; it means it does not contribute to this project’s purpose (examining product design).

The response to items judged useful (decomposing the branch-strategy claim, a JSON Schema for executions/*/results.yml, explicitly documenting ID immutability, cleaning up the knowledge-graph representation, the related-work comparison, weakening the large-scale backfill claim) has already been reflected in the changelog of テスト知識管理のGit-nativeモデル_統合版.md (2026-08-13(3) onward), decisions/0004, and src/schema.rs/src/validate.rs.

Since the response is complete, the evaluation review body (テスト知識管理のGit-nativeモデル_評価レビュー.md), the usefulness-triage document (テスト知識管理のGit-nativeモデル_評価レビュー_有用性判定と修正指示.md), and the execution prompt collection (improvement-prompts.md; for the response to the 2026-08-12 review, items 1–6 and 11 are complete, and items 7–10 are rejected as described below) have all served their purpose, so their key points are transcribed into this decision record and the files are deleted.

Rejected items (judged not useful, no action taken) and their reasons

Files deleted and where their content was transcribed

Conditions for future reconsideration