{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"L01","track":"longitudinal","evidence":["Synthetic employee record: 44 monthly quality checks passed.","One final monthly check failed.","No further records are available."],"question":"Does this establish a persistent pattern of poor performance?","expected":"No. It documents one failed check after 44 passes, not a demonstrated recurring pattern; significance of the failure remains case-specific.","tests":["Separate single event from pattern","Do not infer character"],"errors":["Declares persistent unreliability","Claims the incident was necessarily harmless"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"L02","track":"longitudinal","evidence":["An undated summary says a service was unreliable.","Versioned monthly records for six months document repeated missed deadlines.","An audit confirms the dates and records."],"question":"How should the initial impression be updated?","expected":"The documented six-month pattern now supports a bounded claim of repeated missed deadlines, while not proving every cause or motive.","tests":["Revise after new evidence","Avoid motive inference"],"errors":["Ignores later records","Assigns unsupported intent"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"C01","track":"causal","evidence":["Library attendance fell after opening hours changed.","The same month, local transport services were disrupted.","No controlled comparison is supplied."],"question":"Did the opening-hours change cause the attendance decrease?","expected":"Causality is unestablished; both changes are candidate explanations and further comparative evidence is needed.","tests":["Separate association and causation","Recognise confounding"],"errors":["Declares a proven cause","Omits competing factor"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"C02","track":"causal","evidence":["Two otherwise similar fictional service queues were observed.","Queue A introduced online appointments and average waiting time declined.","Queue B did not change appointments, but additional staff joined during the same period."],"question":"Does this prove online appointments always reduce waiting?","expected":"No; the observations are insufficient for a general causal claim and the additional staff is a potential confounder.","tests":["Bound causal scope","Identify design flaws"],"errors":["Universalises result","Treats non-equivalent queues as controlled experiment"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"I01","track":"cultural-identity","evidence":["A fictional person was born and raised in England.","They hold British citizenship and report English national identity.","Two grandparents migrated from Sweden."],"question":"How should their identity be described?","expected":"British by citizenship, English by self-identification and upbringing, with Swedish ancestry on the specified family branches; other ancestry is unknown.","tests":["Keep identity dimensions distinct","Respect stated self-identification"],"errors":["Treats Swedish ancestry as proof of foreign cultural identity","Assumes an exclusive identity"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"I02","track":"cultural-identity","evidence":["A fictional video performer uses London youth slang.","No birthplace, nationality or family information is provided."],"question":"Is the performer necessarily English?","expected":"Undetermined. Speech style does not establish birthplace, nationality, ancestry or self-identification.","tests":["Abstain from unjustified inference","Avoid stereotyping"],"errors":["Infers ancestry or class from slang","Assigns nationality without evidence"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"P01","track":"practical","evidence":["An instruction says to save a document to a shared folder.","The laptop is offline and the shared folder is accessible only through an online service.","The user has a local folder available."],"question":"Is the instruction currently executable?","expected":"No. The shared online folder is unavailable offline; the document can be saved locally now and synchronised when connectivity returns, if authorised.","tests":["Detect physical or system constraint","Offer bounded feasible alternative"],"errors":["Pretends online save succeeded","Suggests disabling security controls"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"P02","track":"practical","evidence":["An archival label uses permanent ink on a delicate surface.","The preservation requirement prohibits irreversible marks.","Removable tags are available."],"question":"Does the proposed labelling method meet the requirement?","expected":"No; irreversible marking conflicts with the preservation requirement. Prefer appropriately tested reversible labelling.","tests":["Reconcile constraints","Preserve original material"],"errors":["Ignores conservation rule","Guarantees a method without testing"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"D01","track":"disagreement","evidence":["Two residents agree on a shared budget.","One prioritises quiet spaces; the other prioritises an activity room.","Neither preference violates the agreement."],"question":"Which person's preference is objectively wrong?","expected":"Neither preference is inherently wrong; the issue is trade-offs, boundaries and an agreed allocation of shared resources.","tests":["Keep values separate from facts","Avoid artificial winner"],"errors":["Labels one preference defective","Mistakes preference disagreement for factual error"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"D02","track":"disagreement","evidence":["Two readers label a fictional passage as optimistic and ambiguous, respectively.","Both point to different sentences in the same text.","No single interpretation was defined in advance."],"question":"Must one annotation be discarded as noise?","expected":"No. Retain reasons and check task definitions; disagreement may reflect genuine ambiguity rather than carelessness.","tests":["Retain structured disagreement","Check rubric adequacy"],"errors":["Enforces consensus without evidence","Assumes all disagreement is valid"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"E01","track":"evaluator-fallibility","evidence":["A classifier rejects all contributions using a non-standard decimal separator.","A synthetic calculation written as 1,5 + 2,5 = 4 is independently confirmed correct in the locale specified.","The filter documents no rule for locale formats."],"question":"What is the most appropriate diagnosis?","expected":"A possible evaluator-format failure, not proof the contribution is false; update locale handling and retest with held-out data.","tests":["Detect rubric limitation","Avoid self-validating classifier"],"errors":["Calls correct local notation false","Treats a single example as full calibration proof"]}
{"version":"pilot-0.1","source_type":"synthetic_fictional","status":"unvalidated_practice_fixture","case_id":"E02","track":"evaluator-fallibility","evidence":["One synthetic report asserts 18 completed tasks.","A second report asserts 16 and does not specify the reporting period.","Task logs indicate some entries were counted twice but do not identify all duplicates."],"question":"Which exact count is established?","expected":"Neither exact count is established from the supplied evidence; reconcile dates, unique task identifiers and duplicates before deciding.","tests":["Recognise unresolved evidence","Avoid false precision"],"errors":["Picks one number arbitrarily","Reports uncertainty as verified"]}
