experiment: test evidence preservation with one uncertainty

2026-08-12 13:46:29 +01:00
parent 32184694c5
commit 20e4b58440
2 changed files with 150 additions and 0 deletions
@@ -521,6 +521,14 @@ Scenario, answers, and maxUpdates restored to canonical defaults before commit.

 ---

+### Experiment 58A.2 — Evidence + Uncertainty with One Competing Demand
+
+**Objective:** When the answer is reduced to one concrete figure + one qualification + one new uncertainty (no competing assumptions), does the engine preserve the qualified figure while representing the new uncertainty?
+
+**Classification: E — IDENTITY FAILURE.** One update-only call via the committed harness. The engine preserved the £2m/year figure as qualified evidence on n_savings_realism and created a dedicated lease-exit-uncertainty unknown node with clear structural linkage. However, it degraded n_savings_realism from `unknown` to `provisional`, weakening its identity as an unresolved investigation target. The selected question was malformed (template injection failure). Reducing competing demands solved 58A.1's evidence-loss problem but introduced a distinct status-degradation failure. Configured Ollama: qwen-claude:latest at http://192.168.1.111:11434. No production code changed. Full record in `docs/experiment-58a2.md`.
+
+---
+
 ### Experiment 57J.61 — Equivalent Uncertainty Identity Live Test

 **Objective:** Once a dedicated savings-realism uncertainty exists, does a second semantically equivalent statement reuse that same unresolved node rather than create a duplicate? **Classification: D — UPDATE 1 FAILED.** One start + two updates. Start HTTP 200 (6 nodes). Update 1 returned HTTP 200 at update_applied but the harness crash prevented detailed proposal capture. A cold-start variant confirmed that when userSupportedMeaning is populated for savings-realism uncertainty, the model extracts meaning but proposes zero graph mutations — updatedNodes=[{nodeId: X, newValue: null}], addedNodes=[], addedEdges=[]. The gateway rejects this at proposal_compatibility with "answerMeaning.userSupportedMeaning is populated, but the proposal contains no graph mutation." Update 2 was reached (total 3 calls) and was rejected for the same reason. **Neither turn established a persistent savings-realism unknown.** The identity invariant cannot be tested when neither turn produces a valid, persistent unknown node. Configured Ollama: qwen-claude:latest at http://192.168.1.111:11434. No production code changed. Full record in `docs/experiment-57j61.md`.