robbond/confidence-engine
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

experiment: test decision chain across product launch

Browse Source
This commit is contained in:
robbond
2026-08-13 13:04:09 +01:00
parent 43b9e5a35c
commit 229fbfbfd9
3 changed files with 295 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/current-handoff.md
+4
View File
@@ -2847,3 +2847,7 @@ Experiment 60B.15 addressed the unresolved boundary question from 60B.14: **what
Experiment 60B.20 was the live verification of bounded structural context admission from 60B.19 (commit d871a8c). **Classification: A — FULL LIVE CHAIN CONFIRMED.** The exact client-retention case that failed at result_validation in 60B.12 now passes through all stages end-to-end. The model produced `n_client_retention_risk` (kind=unknown, status=unknown) with a `may_cause` edge from opt_relocate. Proposal applied successfully. Decision remains unresolved. Final selectedQuestion targets n_client_retention_risk specifically with text "will our largest client leave if we relocate?". Client risk clearly attributed to Relocate. No fabrication, no over-closure, no unrelated uncertainty invented.
---
---
Experiment 60B.21 tested whether the full reasoning chain from 60B.20 generalises to a materially different decision domain (product launch timing). **Classification: B — MATERIALITY GENERALISES, TARGETING DOES NOT.** The model correctly identified the customer-signing factor as a first-class unknown (kind=unknown, status=unknown), kept the decision open for this specific material factor (£700k of £1.2M), and did not invent unrelated uncertainty. The node `n_customer_signing_status` was selected as the target. However, the final question text ("What would clarify the relevant customer, user, or value recipient in this situation?") is generic rather than specific to customer signing — unlike 60B.20 which produced "will our largest client leave if we relocate?" Option ownership shifted from may_cause (opt→unknown) to depends_on (decision→unknown with conditional attribution in description), preserving correct semantic ownership but with different structural encoding. One live call at qwen-claude:latest on http://192.168.1.111:11434. No production code changed. Status pending Rob's review.