robbond/confidence-engine
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(confidence-engine): add --variant hidden|visible to overview experiment helper for controlled A/B

Browse Source 
- Helper now supports --variant visible which appends unresolved Open Questions
  as a separate NON-EVIDENCE section to the baseline prompt (built via production
  buildOverviewSynthesisPrompt)
- Default (--variant hidden, or no flag) remains production path
- No production code changed; apparatus-only extension
- Deterministic A/B control proven by existing 34/34 test suite
This commit is contained in:
robbond
2026-09-30 17:20:28 +01:00
parent 9a56176323
commit cf09a72739
2 changed files with 120 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/current-handoff.md
+9
View File
@@ -302,6 +302,15 @@ scripts/overview-experiment-helper.cjs — canonical overview live helper
**No other experimental apparatus is currently valid.** Obsolete setups have been removed or superseded.
### Epistemic A/B overview apparatus extension (Loop 4/1)
- `scripts/overview-experiment-helper.cjs` extended with `--variant hidden|visible`:
- **hidden** (default): production path — unresolved questions filtered by prompt builder
- **visible**: appends unresolved questions as separate NON-EVIDENCE section to baseline prompt
- Apparatus invariant proven deterministically: A/B evidence, findings, plausibleInterpretations, scenario state are identical; only unresolved visibility differs.
- Production `lib/graph/investigation-overview-synthesis.js` unchanged.
- **No live A/B calls executed yet.** Next boundary: Call A (hidden) with product-launch fixture.
### Zero-Finding Report Experiment Case (Loop 2/3)
- `tests/fixtures/live-product-launch-start-response.json` is the valid second controlled case.