robbond 5dcaed39df experiment: diagnose decision sufficiency rule ...

Read-only inspection of 8 files (prompt-builder.js, schema.js, utils.js,
apply-proposal.js, orchestrator.js, experiment-60b1.md, experiment-60b2.md,
current-handoff.md). No code changes.

Key findings:
- Prompt has no independent materiality/sufficiency rule (Rule 20 says null
  selectedQuestion when 'no consequential unresolved unknown' but doesn't define
  what makes an unknown non-consequential)
- Validator performs structural checks only, no evidence sufficiency evaluation
- No cross-option comparison logic in propagateResolvedChildEvidence
- Schema has no materiality or couldChangeDecision field
- 60B.1 resolved WITH 'no other material differences' cue; 60B.2 continued
  WITHOUT it, despite internally computing ~3.6 month payback

Classification: C — NO SUFFICIENCY RULE + CONTINUATION BIAS
Missing distinction: MATERIALITY / DECISION-RELEVANCE RULE

2026-08-13 07:15:01 +01:00

..

archive

experiment: separate ui mock reference from deferred backlog

2026-08-06 14:47:34 +01:00

01_Confidence_Engine_Founding_Principles.md

docs: principles and story docs

2026-08-05 19:34:57 +01:00

02_Confidence_Engine_Product_Story.md

docs: principles and story docs

2026-08-05 19:34:57 +01:00

03_Confidence_Engine_Language_Guide.md

docs: principles and story docs

2026-08-05 19:34:57 +01:00

04_Rob_Thinking_Model.md

docs: principles and story docs

2026-08-05 19:34:57 +01:00

architectural-principles.md

architecture: define investigation turn cycle

2026-08-05 16:14:22 +01:00

behaviour-selection.md

docs: narrow behaviour-selection to v0.1 implementation brief

2026-08-05 17:52:01 +01:00

cold-start-validation.md

experiment: validate cold-start project recovery

2026-08-06 16:11:37 +01:00

confidence-engine-decomposition-and-atomic-reasoning-specification.md

doc: decomposition document for codex reasoning development

2026-08-05 06:14:40 +01:00

context-routing-validation.md

experiment: validate cross-boundary context routing

2026-08-06 15:58:41 +01:00

current-handoff.md

experiment: diagnose decision sufficiency rule

2026-08-13 07:15:01 +01:00

current-implementation-verification.md

experiment: verify current project state against implementation

2026-08-06 14:16:57 +01:00

current-project-state.md

docs: close reasoning fidelity v0.8 first pass

2026-08-09 17:25:19 +01:00

current-working-principles.md

experiment: separate current principles from architectural aspirations

2026-08-06 15:07:06 +01:00

design-evolution-log.md

docs: map reasoning requirements to production path

2026-08-08 11:08:37 +01:00

document-role-review.md

experiment: review deferred project documents

2026-08-06 14:33:10 +01:00

experiment-56a.md

experiment: isolate regression B proposal validation

2026-08-09 07:55:11 +01:00

experiment-56b.md

experiment: validate regression B after normalization

2026-08-09 08:25:59 +01:00

experiment-56d.md

experiment: record 56D (Regression B) and 56E (weak-priority strengthening) results

2026-08-09 10:49:22 +01:00

experiment-56e.md

experiment: record 56D (Regression B) and 56E (weak-priority strengthening) results

2026-08-09 10:49:22 +01:00

experiment-56f.md

experiment: validate raw-answer safeguard for weak priority

2026-08-09 12:06:50 +01:00

experiment-56g.md

experiment: validate unresolved uncertainty live path

2026-08-09 12:20:57 +01:00

experiment-56h.md

experiment: validate unresolved uncertainty after harness repair

2026-08-09 12:55:10 +01:00

experiment-56j.md

experiment: probe explicit hard constraint semantic fidelity

2026-08-09 14:13:48 +01:00

experiment-56k.md

experiment: probe evidence versus clarification boundary

2026-08-09 15:11:54 +01:00

experiment-56l.md

experiment: probe user-owned ambiguity boundary

2026-08-09 15:21:02 +01:00

experiment-56m.md

experiment: validate evidence versus clarification routing

2026-08-09 16:33:14 +01:00

experiment-57a.md

docs: record contaminated experiment 57a observation

2026-08-09 19:40:49 +01:00

experiment-57b.md

experiment: validate grounded unclassified answer live

2026-08-09 20:03:30 +01:00

experiment-57c.md

docs: record stopped experiment 57c contract failure

2026-08-10 06:04:46 +01:00

experiment-57e.md

experiment: locate irrelevant decomposition question boundary

2026-08-10 07:19:52 +01:00

experiment-57f.md

experiment: validate decomposition relevance live

2026-08-10 08:04:59 +01:00

experiment-57g.md

experiment: validate semantic compatibility live

2026-08-10 08:46:31 +01:00

experiment-57i.md

experiment: validate relationship fallback live

2026-08-10 13:10:21 +01:00

experiment-57j2.md

experiment: capture minimal clarification answerability

2026-08-10 14:26:07 +01:00

experiment-57j6.md

docs: record rejected answerability corroboration candidate

2026-08-10 15:08:23 +01:00

experiment-57j11.md

experiment: observe live unknown dimensionality representation

2026-08-10 15:41:49 +01:00

experiment-57j25.md

experiment: validate user-supported unknown admission live

2026-08-11 06:38:30 +01:00

experiment-57j26.md

experiment: observe post-admission investigation progress

2026-08-11 06:56:35 +01:00

experiment-57j28.md

experiment: capture live node-support semantic inputs

2026-08-11 07:12:30 +01:00

experiment-57j29.md

experiment: measure live semantic representation stability

2026-08-11 07:36:21 +01:00

experiment-57j30.md

experiment: capture proposal-boundary live variance

2026-08-11 08:19:21 +01:00

experiment-57j31.md

experiment: add rejected proposal diagnostics to failure path

2026-08-11 08:33:36 +01:00

experiment-57j32.md

experiment: inspect rejected proposal live variance

2026-08-11 10:03:35 +01:00

experiment-57j33.md

experiment: classify captured answer-meaning strengthening

2026-08-11 10:19:19 +01:00

experiment-57j34.md

experiment: observe guarded multi-turn progress

2026-08-11 10:50:05 +01:00

experiment-57j35.md

tooling: enforce no-retry live experiment harness

2026-08-11 11:32:19 +01:00

experiment-57j36.md

experiment: rerun guarded multi-turn progress cleanly

2026-08-11 11:41:51 +01:00

experiment-57j37.md

experiment: locate semantic-to-mutation contract gap

2026-08-11 11:56:36 +01:00

experiment-57j38.md

experiment: choose semantic-to-mutation contract fix

2026-08-11 12:03:16 +01:00

experiment-57j39.md

docs: experiment 57J.39 record and handoff update

2026-08-11 12:32:39 +01:00

experiment-57j40.md

experiment: validate semantic-to-mutation contract live

2026-08-11 13:01:54 +01:00

experiment-57j41.md

experiment: isolate semantic-to-mutation contract live

2026-08-11 13:09:51 +01:00

experiment-57j42.md

experiment: diagnose structural-mutation prompt compliance

2026-08-11 13:15:27 +01:00

experiment-57j43.md

docs: experiment 57J.43 record and handoff update

2026-08-11 13:23:14 +01:00

experiment-57j44.md

experiment: validate conflict-free mutation prompt live

2026-08-11 13:36:03 +01:00

experiment-57j45.md

experiment: choose structural action-selection rule

2026-08-11 14:01:42 +01:00

experiment-57j46.md

docs: experiment 57J.46 record and handoff update

2026-08-11 14:15:50 +01:00

experiment-57j47.md

experiment: diagnose uncertainty fidelity false positive

2026-08-11 14:56:15 +01:00

experiment-57j48.md

experiment: diagnose uncertainty fidelity false positive

2026-08-11 14:56:15 +01:00

experiment-57j49.md

experiment: assess structured semantic fidelity boundary

2026-08-11 15:04:47 +01:00

experiment-57j50.md

experiment: choose structured fidelity migration

2026-08-11 16:17:55 +01:00

experiment-57j51.md

docs: record structured semantic fidelity implementation

2026-08-11 16:46:30 +01:00

experiment-57j52.md

experiment: validate structured semantic fidelity live

2026-08-11 17:18:59 +01:00

experiment-57j53.md

experiment: test structured-fidelity multi-turn progress

2026-08-11 17:34:54 +01:00

experiment-57j54.md

experiment: diagnose uncertainty identity vs relatedness

2026-08-11 17:41:23 +01:00

experiment-57j55.md

docs: record uncertainty identity clarification

2026-08-11 17:47:45 +01:00

experiment-57j56.md

experiment: validate uncertainty identity live

2026-08-11 18:02:11 +01:00

experiment-57j57.md

experiment: validate equivalent uncertainty reuse live

2026-08-11 18:29:02 +01:00

experiment-57j58.md

experiment: diagnose selected-question ownership

2026-08-11 18:45:00 +01:00

experiment-57j59.md

docs: record selected-question contract alignment

2026-08-11 18:51:51 +01:00

experiment-57j60.md

experiment: validate selected-question contract live

2026-08-11 19:15:51 +01:00

experiment-57j61.md

experiment: validate equivalent uncertainty identity live

2026-08-11 19:30:08 +01:00

experiment-57j62.md

docs: record accepted-update capture hardening

2026-08-11 19:43:11 +01:00

experiment-57j63.md

experiment: rerun equivalent uncertainty identity with hardened capture

2026-08-12 05:48:18 +01:00

experiment-57j64.md

experiment: diagnose semantic-to-mutation action ownership

2026-08-12 05:53:58 +01:00

experiment-57j65.md

experiment: define semantic action contract

2026-08-12 06:13:15 +01:00

experiment-57j66.md

experiment: define semantic action contract placement

2026-08-12 06:23:21 +01:00

experiment-57j67.md

experiment: finalize semantic action contract semantics

2026-08-12 06:30:40 +01:00

experiment-57j68.md

docs: record structural action contract implementation

2026-08-12 07:29:28 +01:00

experiment-57j69.md

experiment: validate structural action contract live

2026-08-12 08:04:41 +01:00

experiment-57j70.md

docs: record structural action guard cleanup

2026-08-12 08:17:28 +01:00

experiment-57j71.md

experiment: rerun structural action contract live

2026-08-12 08:26:58 +01:00

experiment-57j72.md

docs: record structural action capture hardening

2026-08-12 08:33:06 +01:00

experiment-57j73.md

experiment: validate intentional structural no-op live

2026-08-12 08:49:40 +01:00

experiment-57j74.md

docs: record pre-anchored update apparatus

2026-08-12 09:13:40 +01:00

experiment-57j75.md

experiment: validate controlled structural no-op live

2026-08-12 09:35:05 +01:00

experiment-57j77.md

experiment: audit pre-anchored live apparatus

2026-08-12 09:56:11 +01:00

experiment-57j78.md

tooling: add pre-anchored update-only mode to canonical harness

2026-08-12 10:19:09 +01:00

experiment-57j80.md

experiment: test incremental meaning on existing uncertainty

2026-08-12 10:34:53 +01:00

experiment-57j81.md

docs: record update-only previous-question fix

2026-08-12 10:41:31 +01:00

experiment-57j82.md

experiment: rerun incremental meaning on anchored uncertainty

2026-08-12 11:19:47 +01:00

experiment-57j83.md

docs: record accepted answer-meaning capture

2026-08-12 12:01:16 +01:00

experiment-57j84.md

experiment: observe direct meaning/action fields on anchored update

2026-08-12 12:09:32 +01:00

experiment-57j85.md

experiment: diagnose null semantic mutation path

2026-08-12 13:19:37 +01:00

experiment-57j86.md

experiment: choose declaration recovery boundary

2026-08-12 13:27:02 +01:00

experiment-58a1.md

experiment: test qualified-answer reasoning

2026-08-12 13:35:40 +01:00

experiment-58a2.md

experiment: test evidence preservation with one uncertainty

2026-08-12 13:46:29 +01:00

experiment-58a3.md

experiment: test next-question formulation

2026-08-12 13:53:03 +01:00

experiment-58a4.md

docs: record question-formulation fix

2026-08-12 15:07:13 +01:00

experiment-58a5.md

experiment: validate question-formulation fix live

2026-08-12 15:29:38 +01:00

experiment-58a6.md

experiment: exercise interrogative question rendering live

2026-08-12 15:35:00 +01:00

experiment-58b1.md

experiment: test qualified evidence uncertainty status

2026-08-12 16:02:28 +01:00

experiment-58b2.md

experiment: test verified uncertainty resolution

2026-08-12 16:26:43 +01:00

experiment-59a1.md

experiment: test shift into trade-off reasoning

2026-08-12 16:37:52 +01:00

experiment-59a2.md

experiment: test trade-off decomposition

2026-08-12 16:51:39 +01:00

experiment-59a3.md

experiment: test known-vs-uncertain consequence structure

2026-08-12 16:59:56 +01:00

experiment-59b1.md

experiment: test decision relevance and do-nothing baseline

2026-08-12 17:10:01 +01:00

experiment-59b2.md

experiment: test independent decision relevance

2026-08-12 17:18:18 +01:00

experiment-59b3.md

experiment: test do-nothing baseline representation

2026-08-12 17:42:25 +01:00

experiment-59b4.md

experiment: test explicit two-option decision structure

2026-08-12 17:52:38 +01:00

experiment-60a1.md

exp 60A.1: read-only vocabulary adequacy diagnosis for alternatives and decisions

2026-08-12 18:19:29 +01:00

experiment-60a2.md

experiment: choose minimum decision representation

2026-08-12 18:34:18 +01:00

experiment-60a4.md

experiment: validate native option structure live

2026-08-12 19:49:02 +01:00

experiment-60a5.md

experiment: test option-specific consequence structure

2026-08-13 05:53:20 +01:00

experiment-60a6.md

experiment: rerun option consequence structure once

2026-08-13 06:08:23 +01:00

experiment-60a7.md

feat(60A.7): add reusable decision-options fixture loading in test harness

2026-08-13 06:24:12 +01:00

experiment-60a8.md

experiment: test downstream option evidence update

2026-08-13 06:30:24 +01:00

experiment-60b1.md

experiment: test decision sufficiency on option graph

2026-08-13 06:39:12 +01:00

experiment-60b2.md

experiment: test independent decision sufficiency

2026-08-13 06:47:10 +01:00

experiment-60b3.md

experiment: diagnose decision sufficiency rule

2026-08-13 07:15:01 +01:00

facilitator-behaviour.md

architecture: introduce investigation state assessment

2026-08-05 16:09:24 +01:00

failure-modes.md

architecture: define investigation turn cycle

2026-08-05 16:14:22 +01:00

investigation-narrative.md

architecture: introduce investigation narrative layer

2026-08-05 15:53:22 +01:00

investigation-state-assessment-contract.md

exp(18): implement investigation state assessment layer

2026-08-05 17:52:18 +01:00

investigation-state-assessment.md

exp(18): implement investigation state assessment layer

2026-08-05 17:52:18 +01:00

investigation-turn-cycle.md

exp(18): implement investigation state assessment layer

2026-08-05 17:52:18 +01:00

orchestrator-contract.md

experiment: archive historical project documents

2026-08-06 14:24:52 +01:00

project-knowledge-inventory.md

experiment: create single return-to-work handoff

2026-08-06 15:37:12 +01:00

reasoning-contract-backlog.md

docs: narrow behaviour-selection to v0.1 implementation brief

2026-08-05 17:52:01 +01:00

reasoning-production-path-map.md

docs: map reasoning requirements to production path

2026-08-08 11:08:37 +01:00

reasoning-refinement-requirements.md

docs: close reasoning fidelity v0.8 first pass

2026-08-09 17:25:19 +01:00

success-signals.md

architecture: define investigation turn cycle

2026-08-05 16:14:22 +01:00

task-context-packs.md

docs: record canonical live multi-turn product-observation route

2026-08-10 06:49:03 +01:00

ui-mock-reference.md

experiment: separate ui mock reference from deferred backlog

2026-08-06 14:47:34 +01:00

v0.5-question-priority-generalisation.md

test: generalise question priority across decisions

2026-08-02 13:02:49 +01:00

v0.6-atomicity-experiment.md

feat: evaluate deterministic cross-branch corroboration

2026-08-03 07:19:20 +01:00

v0.6-comparability-experiment.md

feat: back next questions with explicit graph unknowns

2026-08-02 19:03:07 +01:00

v0.6-reasoning-architecture.md

docs: document v0.6 reasoning architecture

2026-08-03 07:24:46 +01:00

v0.6-release-notes.md

docs: add v0.6 release notes

2026-08-03 07:38:05 +01:00

v0.6-selection-influence-experiment.md

test: inspect structural influence in unknown selection

2026-08-02 15:40:06 +01:00

v0.7-question-simplicity-experiment.md

feat: enforce reasoning pattern consistency

2026-08-03 12:10:57 +01:00

v0.7-ui-mock-mode.md

feat: add mock-mode docs and additional e2e tests (long investigation, recovery states)

2026-08-05 08:38:44 +01:00

v0.7-user-workspace-ux-first-pass.md

fix: clarify reasoning progress and loading feedback

2026-08-03 15:44:34 +01:00