docs: [verified] move metric contracts under Measurement
Build and publish Eldorado documentation / build (pull_request) Successful in 41s
Build and publish Eldorado documentation / build (pull_request) Successful in 41s
This commit is contained in:
1 parent
b9c2047c61
commit
85852f0744
45 files changed
+1101
-433
No files matched your search
@@ -0,0 +1,36 @@
|
||||
---
|
||||
id: changes-with-escaped-quality-issues
|
||||
slug: /measurement/changes-with-escaped-quality-issues
|
||||
title: Changes with escaped quality issues
|
||||
description: Definition, collection evidence and limitations for changes with escaped quality issues.
|
||||
---
|
||||
|
||||
<div className="strategy-content">
|
||||
|
||||
**Target operating model — recommended contracts, not installed collection.** All owner and cadence entries below are proposals to confirm before the pilot, not assigned responsibilities or approved schedules.
|
||||
|
||||
**Prototype calculation — no live telemetry.** The synthetic example calculates this metric; it has no network collectors.
|
||||
|
||||
{/* contract:start */}
|
||||
Accepted changes with at least one confirmed post-acceptance defect during approved follow-up, split by severity.
|
||||
|
||||
| Contract | Definition |
|
||||
| --- | --- |
|
||||
| Numerator | Distinct eligible change_ids with one or more linked confirmed defects in follow-up |
|
||||
| Denominator | Accepted change_ids with completed predeclared follow-up horizon |
|
||||
| Expression | N / D * 100 |
|
||||
| Aggregation | percent |
|
||||
| Unit | % |
|
||||
| Eligible population | Accepted changes in acceptance window whose follow-up is complete by as_of. |
|
||||
| Exclusions | Immature changes shown separately; duplicates/unconfirmed reports excluded but counted as pending triage. |
|
||||
| Events and source | change.accepted; defect.confirmed; defect tracking and acceptance evidence |
|
||||
| Owner / cadence | Quality Engineering / Monthly mature cohorts |
|
||||
| Missing evidence | Unknown linkage is a coverage warning; no fabricated clean outcome. Show absolute defect and severe incident counts as well. |
|
||||
| Gaming and limits | Shorten follow-up or downgrade severity; freeze horizon and rubric and independently sample defects. Descriptive signal, not causal AI productivity attribution. Source completeness, task mix and sampling limit inference; report uncertainty. Counts affected changes, not raw defects per change; no presumption defects are AI-caused. |
|
||||
{/* contract:end */}
|
||||
|
||||
Read the shared [collection and safeguards](./collection-and-safeguards.mdx) before collecting data; see the [synthetic example and limits](./synthetic-example.mdx).
|
||||
|
||||
Return to [Skills Measurement](./index.mdx).
|
||||
|
||||
</div>
|
||||
Reference in new issue
Block a user