experiment: validate unresolved uncertainty live path
This commit is contained in:
@@ -0,0 +1,48 @@
|
||||
# Experiment 56G — Validate Unresolved Uncertainty Through Live Production Path
|
||||
|
||||
**Date**: 2026-08-09
|
||||
**Branch**: feature/reasoning-fidelity-v0.8
|
||||
**Type**: Live experiment — BLOCKED by apparatus failure
|
||||
**Status**: BLOCKED - apparatus
|
||||
|
||||
---
|
||||
|
||||
## Objective
|
||||
|
||||
Answer: When the user says "I'm not really sure.", does the production path preserve that uncertainty instead of resolving or strengthening the risk-constraint distinction?
|
||||
|
||||
## Fixed Case — Regression C
|
||||
|
||||
- **Source**: "I want the business to grow, but I don't want to take on more risk."
|
||||
- **Previous question**: "Is avoiding additional risk a hard constraint or a preference/trade-off?"
|
||||
- **Answer**: "I'm not really sure."
|
||||
- **Expected preserved meaning**: User is uncertain about whether avoiding additional risk is a hard constraint or preference/trade-off.
|
||||
- **Expected uncertainty**: Full — no position taken.
|
||||
|
||||
## Apparatus Failure
|
||||
|
||||
The canonical helper (`tests/graph/live-update-experiment-helper.cjs`) contains a broken import path:
|
||||
|
||||
```js
|
||||
const { updateCase } = await import("../lib/graph/orchestrator.js");
|
||||
```
|
||||
|
||||
From its location at `tests/graph/`, this resolves to `tests/lib/graph/orchestrator.js` — which does not exist. The correct relative path is `../../lib/graph/orchestrator.js`.
|
||||
|
||||
The canonical helper cannot invoke the production path without a fix to this import.
|
||||
|
||||
## Result
|
||||
|
||||
**BLOCKED - apparatus**
|
||||
|
||||
No live calls were made. No experiment data captured.
|
||||
|
||||
## Evidence
|
||||
|
||||
- File exists: `./lib/graph/orchestrator.js` (project root)
|
||||
- File missing: `tests/lib/graph/orchestrator.js`
|
||||
- Broken path: `../lib/graph/orchestrator.js` from `tests/graph/live-update-experiment-helper.cjs`
|
||||
|
||||
---
|
||||
|
||||
*Status pending Rob's review. Requires canonical helper import path fix before this experiment can proceed.*
|
||||
Reference in New Issue
Block a user