Assessment pilot record

Use one copy per real pilot session. This template is a data collection aid, not evidence that a pilot has occurred. Do not record secrets, private personnel details, or unnecessary participant identifiers. Summarize findings without names.

Session context

• Pilot ID: {{PILOT_01_02_03}}
• Date: {{DATE}}
• Project context: {{E.G._NEW_PRODUCT_OR_MATURE_SERVICE}}
• Spec version: {{VERSION}}
• Profile and selected scope: {{FULL_OR_LITE_AND_SCOPE}}
• Facilitator role: {{ROLE_OR_UNASSIGNED}}
• Participant role labels: {{ROLE_LABELS_ONLY}}
• Start / end: {{TIMES}}
• Elapsed time: {{MINUTES}}
• Completed / applicable items: {{CONFIRMED}} / {{APPLICABLE}}
• Unanswered or deferred items: {{COUNT_AND_IDS}}
• Stopping point and reason, if incomplete: {{DETAILS_OR_NONE}}

Interview flow observations

Observation	Notes
Follow-up questions needed beyond the prompts	{{COUNT_AND_EXAMPLES}}
Prompts that were unclear or interpreted differently	{{ITEM_IDS_AND_WHAT_WAS_UNCLEAR}}
Evidence repeated across items	{{ITEM_IDS_AND_WHETHER_REUSE_WORKED}}
Evidence asked for but unavailable	{{ITEM_IDS_AND_REASON}}
Long pauses, fatigue, or points where the participant wanted to stop	{{ITEM_IDS_AND_CONTEXT}}
Questions skipped because earlier evidence already answered them	{{ITEM_IDS}}

Record observed behavior and anonymized examples. Do not infer a rating from session duration or participant confidence.

Independent rating exercise

Choose a small shared set of items and evidence. Two assessors rate the evidence independently before discussing it. Do not show either assessor the other's ratings first.

Item	Evidence summary	Assessor A importance / state	Assessor B importance / state	Difference and rationale
{{ID}}	{{ANONYMIZED_EVIDENCE}}	{{1-3 / 0-4}}	{{1-3 / 0-4}}	{{WHERE_AND_WHY_RATINGS_DIFFER}}

After independent ratings, discuss differences and record whether the item wording or level descriptions contributed. Small pilots do not establish statistical reliability or validation.

Usefulness and follow-up

• Which recommendations or findings were actionable to the team? {{NOTES}}
• Which findings were surprising or not useful? {{NOTES}}
• What evidence or prompt should change, and why? {{ITEM_IDS_AND_RATIONALE}}
• Would the team repeat the assessment? {{YES_NO_AND_REASON}}
• Changes proposed: {{LIST_OR_NONE}}
• Do any proposed changes alter item or scoring meaning? {{YES_NO_DETAILS}}

Cross-session summary (complete after at least three sessions)

Pilot	Context	Minutes	Completion	Follow-ups	Deferred / unanswered	Main friction
{{PILOT_ID}}	{{CONTEXT}}	{{MINUTES}}	{{CONFIRMED/APPLICABLE}}	{{COUNT}}	{{COUNT}}	{{SUMMARY}}

Summarize recurring unclear prompts, repeated evidence, rating disagreements, drop-off points, and useful recommendations. Separate observations from interpretation. Tie each proposed change to pilot evidence; follow the spec versioning policy for any semantic change.