jarvis-at-skic
85852f0744
Build and publish Eldorado documentation / build (pull_request) Successful in 41s
37 lines
2.3 KiB
Plaintext
37 lines
2.3 KiB
Plaintext
---
|
||
id: verification-confidence-and-cognitive-load
|
||
slug: /measurement/verification-confidence-and-cognitive-load
|
||
title: Verification confidence and cognitive load
|
||
description: Definition, collection evidence and limitations for verification confidence and cognitive load.
|
||
---
|
||
|
||
<div className="strategy-content">
|
||
|
||
**Target operating model — recommended contracts, not installed collection.** All owner and cadence entries below are proposals to confirm before the pilot, not assigned responsibilities or approved schedules.
|
||
|
||
**Prototype calculation — no live telemetry.** The synthetic example calculates this metric; it has no network collectors.
|
||
|
||
{/* contract:start */}
|
||
Three separate anonymous 1–5 item distributions: confidence in verifying output, manageable workload, usefulness. Primary item: verification confidence mean; report full distributions and response rate.
|
||
|
||
| Contract | Definition |
|
||
| --- | --- |
|
||
| Numerator | Sum valid 1–5 verification-confidence responses, one per participant per survey wave |
|
||
| Denominator | Count valid responses to that item |
|
||
| Expression | N / D |
|
||
| Aggregation | mean |
|
||
| Unit | points (1–5) |
|
||
| Eligible population | Invited eligible cohort at fixed survey wave; voluntary responses. |
|
||
| Exclusions | Invalid/out-of-range answers and superseded duplicate submission; nonresponders stay in response-rate denominator. |
|
||
| Events and source | survey.response; anonymous survey with single-use token and aggregate invitation count |
|
||
| Owner / cadence | People & Administration Squad / After pilot workflow cycle; periodic follow-up |
|
||
| Missing evidence | Report valid response count / invited count and item nonresponse; no imputation. Suppress people cohorts below five. |
|
||
| Gaming and limits | Pressure to respond positively; no manager access to individual responses, avoid identifying free text. Descriptive signal, not causal AI productivity attribution. Source completeness, task mix and sampling limit inference; report uncertainty. Perception and selection bias; not measured time savings. No composite productivity index. |
|
||
{/* contract:end */}
|
||
|
||
Read the shared [collection and safeguards](./collection-and-safeguards.mdx) before collecting data; see the [synthetic example and limits](./synthetic-example.mdx).
|
||
|
||
Return to [Skills Measurement](./index.mdx).
|
||
|
||
</div>
|