experiment: test structured-fidelity multi-turn progress

2026-08-11 17:34:54 +01:00
parent 5947ccb642
commit 19c00f3bf3
2 changed files with 185 additions and 0 deletions
@@ -175,6 +175,22 @@ _Created by Experiment 34. Updated by Experiments 38–53, 54A–54Z, 55A–55F,

 ---

+### Experiment 57J.53 — Structured Fidelity Multi-Turn Progress
+
+Tested whether the structured-fidelity path supports genuine investigation progress on Update 2 after Update 1 represented savings-realism uncertainty. **Classification: B — USEFUL PARTIAL PROGRESS.**
+
+Two-turn run (fixed scenario: "We are considering relocating the engineering team to reduce operating costs.") with Answer 1 ("I am unsure whether the projected office savings from the relocation are realistic.") and Answer 2 ("The projected savings are based on the current London lease, business rates, service charges, utilities and facilities costs that would no longer be incurred at the same level after the move. The estimate is approximately £2M per year.")
+
+**Update 1:** HTTP 200, supportCategory="uncertain", but did not create a dedicated savings-realism unknown node — instead degraded an existing unrelated node's status to provisional. Selected next question referenced "realism of projected office savings" correctly. Partial success: structured field populated but downstream structural action was weak.
+
+**Update 2:** HTTP 200, supportCategory="other". Added new supported metric node (£2M/year savings) but did not act on the existing savings-realism uncertainty from Update 1. Evidence and uncertainty exist in parallel with no cross-linkage. No next question generated due to unknown-selection tie (all three original unknowns tied).
+
+**Key finding:** Structured `supportCategory` works correctly across turns (model adapts category to answer semantics), but the downstream graph effect of "uncertain" status was not a dedicated unknown node as expected from 57J.52's earlier pattern. Evidence was added in Update 2 but remained structurally disconnected from the existing uncertainty. Cold-start variance (7 vs 8 nodes) may affect whether new-node creation triggers for this category.
+
+**What remains unproven:** Stability of no-new-node behavior for uncertain status; whether cold-start node count determines structured-path outcomes; tie-breaking resolution mechanism that blocked next-question generation. Configured Ollama: qwen-claude:latest at http://192.168.1.111:11434. No production code changed.
+
+---
+
 ### Experiment 57E — Irrelevant Decomposition Question Boundary

 **Objective:** Identify the exact graph node that triggered the decomposition producing "How the two observations were measured", and determine whether the parent was genuinely about comparison/measurement/timing before decomposition.