Files
confidence-engine/docs/experiment-56g.md
T

1.7 KiB

Experiment 56G — Validate Unresolved Uncertainty Through Live Production Path

Date: 2026-08-09
Branch: feature/reasoning-fidelity-v0.8
Type: Live experiment — BLOCKED by apparatus failure
Status: BLOCKED - apparatus


Objective

Answer: When the user says "I'm not really sure.", does the production path preserve that uncertainty instead of resolving or strengthening the risk-constraint distinction?

Fixed Case — Regression C

  • Source: "I want the business to grow, but I don't want to take on more risk."
  • Previous question: "Is avoiding additional risk a hard constraint or a preference/trade-off?"
  • Answer: "I'm not really sure."
  • Expected preserved meaning: User is uncertain about whether avoiding additional risk is a hard constraint or preference/trade-off.
  • Expected uncertainty: Full — no position taken.

Apparatus Failure

The canonical helper (tests/graph/live-update-experiment-helper.cjs) contains a broken import path:

const { updateCase } = await import("../lib/graph/orchestrator.js");

From its location at tests/graph/, this resolves to tests/lib/graph/orchestrator.js — which does not exist. The correct relative path is ../../lib/graph/orchestrator.js.

The canonical helper cannot invoke the production path without a fix to this import.

Result

BLOCKED - apparatus

No live calls were made. No experiment data captured.

Evidence

  • File exists: ./lib/graph/orchestrator.js (project root)
  • File missing: tests/lib/graph/orchestrator.js
  • Broken path: ../lib/graph/orchestrator.js from tests/graph/live-update-experiment-helper.cjs

Status pending Rob's review. Requires canonical helper import path fix before this experiment can proceed.