1.7 KiB
Experiment 56G — Validate Unresolved Uncertainty Through Live Production Path
Date: 2026-08-09
Branch: feature/reasoning-fidelity-v0.8
Type: Live experiment — BLOCKED by apparatus failure
Status: BLOCKED - apparatus
Objective
Answer: When the user says "I'm not really sure.", does the production path preserve that uncertainty instead of resolving or strengthening the risk-constraint distinction?
Fixed Case — Regression C
- Source: "I want the business to grow, but I don't want to take on more risk."
- Previous question: "Is avoiding additional risk a hard constraint or a preference/trade-off?"
- Answer: "I'm not really sure."
- Expected preserved meaning: User is uncertain about whether avoiding additional risk is a hard constraint or preference/trade-off.
- Expected uncertainty: Full — no position taken.
Apparatus Failure
The canonical helper (tests/graph/live-update-experiment-helper.cjs) contains a broken import path:
const { updateCase } = await import("../lib/graph/orchestrator.js");
From its location at tests/graph/, this resolves to tests/lib/graph/orchestrator.js — which does not exist. The correct relative path is ../../lib/graph/orchestrator.js.
The canonical helper cannot invoke the production path without a fix to this import.
Result
BLOCKED - apparatus
No live calls were made. No experiment data captured.
Evidence
- File exists:
./lib/graph/orchestrator.js(project root) - File missing:
tests/lib/graph/orchestrator.js - Broken path:
../lib/graph/orchestrator.jsfromtests/graph/live-update-experiment-helper.cjs
Status pending Rob's review. Requires canonical helper import path fix before this experiment can proceed.