robbond/confidence-engine
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

experiment: test semantic grounding stability

Browse Source
This commit is contained in:
robbond
2026-08-07 17:13:41 +01:00
parent 118c5a789f
commit fb5368ec5f
3 changed files with 580 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/current-handoff.md
+3 -3
View File
@@ -135,8 +135,8 @@ Answer before continuing:
---
*Created by Experiment 34. Updated by Experiments 38–53, 54A–54K. Branch: `feature/user-workspace-ux-v0.7`.*
*Created by Experiment 34. Updated by Experiments 38–53, 54A–54L. Branch: `feature/user-workspace-ux-v0.7`.*
### Return-to-Work Note (Experiment 54K)
### Return-to-Work Note (Experiment 54L)
Experiment 54J proved the representation can separate source-supported from interpretation-added meaning using human-fixed references. Experiment 54K tested whether the semantic model can perform that grounding automatically: two of three cases were grounding_correct, one was partial_grounding (model missed one addition — "alternative causes" — on the added side). Interpretation-added meaning did not leak into source-supported meaning in any case. Winner selection and downstream questions remain untested. Same Ollama host (`192.168.1.111:11434`) and model (`qwen-claude:latest`) retained; no production behaviour changed. Branch: `feature/user-workspace-ux-v0.7`. First file to inspect when resuming: `tests/reconstruction/semantic-interpretation-grounding.test.js`.
Experiment 54K showed automatic grounding was promising but incomplete — two of three cases were correct, one missed an addition. Experiment 54L repeated two identical grounding cases three times each to test stability. The source-versus-added boundary remained stable (zero leakage across all six runs). Detection completeness was variable — the model did not consistently identify every added concept on repeat calls, even when it correctly kept everything on its proper side. Correctness ranking and downstream questions remain untested. Same host/model retained; no production behaviour changed. Branch: `feature/user-workspace-ux-v0.7`. First file to inspect when resuming: `tests/reconstruction/semantic-grounding-stability.test.js`.