robbond/confidence-engine
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

experiment: test qualified evidence uncertainty status

Browse Source
This commit is contained in:
robbond
2026-08-12 16:02:28 +01:00
parent 201f259326
commit 52c529a688
2 changed files with 177 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/current-handoff.md
+6
View File
@@ -1794,3 +1794,9 @@ The hypothesis asked whether selecting `n_savings_realism` would now produce a c
**Objective:** When the answer simply preserves the existing savings-realism uncertainty and introduces no new issue, does the live engine select that existing interrogative node and render its next question coherently through the 58A.4 fix?
**Classification: E — NO QUESTION.** One update-only call via the committed harness. The update was rejected at `proposal_compatibility` with HTTP 422 because `structuralActionRequired=true` but the proposal contained no graph mutation (only `[updatedNodes: [{nodeId: n_savings_realism, newValue: null}]]`). The model correctly extracted user meaning ("The user remains unsure about whether the projected office savings from relocation are realistic.") but could not produce any structural change because the answer provided only uncertainty confirmation with zero new evidence. No next question was emitted because the apparatus blocks before question-selection. **This is a semantic gap:** pure-preservation answers provide no mutation target, yet the engine treats the uncertainty as requiring structural action. The 58A.4 interrogative fix path remains unproven live. Configured Ollama: qwen-claude:latest at http://192.168.1.111:11434. No production code changed.
### Experiment 58B.1 — Qualified Evidence Without Weakening Uncertainty (CONTROLLED)
**Objective:** When the user provides a concrete £2m figure but explicitly states it is unverified, does the engine preserve the figure and keep the existing savings-realism uncertainty unresolved?
**Classification: A — QUALIFIED EVIDENCE AND UNCERTAINTY BOTH PRESERVED.** One update-only call via the committed harness (confirmed by direct API inspection). The engine preserved the £2m/year figure as `"£2M/year (unverified)"` on n_savings_realism, kept status as `unknown` (not weakened to provisional), confidence set to low, answerMeaning.supportCategory = `"uncertain"`, possibleInference = null. No duplicate nodes, no resolved unknowns. Selected question continues investigating the realism concern. This is the best result seen for savings-realism across all 58A/B experiments — evidence and uncertainty both survive intact. Configured Ollama: qwen-claude:latest at http://192.168.1.111:11434. No production code changed.