# v0.7 Observation Report

**Date**: 2026-08-03 | **Commit**: c273209 | **Branch**: feature/reasoning-pattern-memory-v0.7

## Summary Table

| Scenario | Name | Start | Update | Nodes | Unknowns | Rating |
|----------|------|-------|--------|-------|----------|--------|
| scenario-1 | Confidence Engine commercial validation | pass | fail(400) | 9 | 3 | flow failure |
| scenario-2 | Hiring | pass | fail(400) | 18 | 8 | flow failure |
| scenario-3 | Vehicle replacement | pass | fail(400) | 15 | 8 | flow failure |
| scenario-4 | Welsh Government-style programme decision | pass | fail(400) | 10 | 3 | flow failure |
| scenario-5 | Operational contradiction | pass | fail(400) | 7 | 2 | flow failure |
| scenario-6 | Personal decision | fail | skipped | 0 | 0 | flow failure |

## Per-Scenario Findings

### scenario-1: Confidence Engine commercial validation

- **Overall**: Start=pass, Update=fail(400), Rating=flow failure
- Pattern: N/A | Nodes: 9 | Edges: 0
- Validation: valid | Duration: 63386ms
- Unknown IDs: nirkgb4, n36c0cc, nzeyzkz
- Error: [N/A] Invalid update-case request

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

### scenario-2: Hiring

- **Overall**: Start=pass, Update=fail(400), Rating=flow failure
- Pattern: N/A | Nodes: 18 | Edges: 5
- Validation: valid | Duration: 146476ms
- Unknown IDs: n7yonyv, npci7a7, nug9wj2, nz0vpey, nz8pwyc, newxmzu, nw14mjj, n25mnp3
- Error: [N/A] Invalid update-case request

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

### scenario-3: Vehicle replacement

- **Overall**: Start=pass, Update=fail(400), Rating=flow failure
- Pattern: N/A | Nodes: 15 | Edges: 5
- Validation: valid | Duration: 81460ms
- Unknown IDs: ng5yr11, nogqips, n499gin, n8fbv3p, nf2f6zx, n4feiap, nvwthlt, nqrxjli
- Error: [N/A] Invalid update-case request

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

### scenario-4: Welsh Government-style programme decision

- **Overall**: Start=pass, Update=fail(400), Rating=flow failure
- Pattern: N/A | Nodes: 10 | Edges: 0
- Validation: valid | Duration: 129682ms
- Unknown IDs: nrrm3qn, nefmpat, n6rtwg1
- Error: [N/A] Invalid update-case request

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

### scenario-5: Operational contradiction

- **Overall**: Start=pass, Update=fail(400), Rating=flow failure
- Pattern: N/A | Nodes: 7 | Edges: 0
- Validation: valid | Duration: 70579ms
- Unknown IDs: n6gm2cv, nylhu9g
- Error: [N/A] Invalid update-case request

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

### scenario-6: Personal decision

- **Overall**: Start=fail, Update=skipped, Rating=flow failure
- Pattern: N/A | Nodes: 0 | Edges: 0
- Validation: invalid | Duration: 72547ms

- **Assessment**:
  - reasoning-pattern fit: fail
  - one-concept simplicity: fail
  - plain-language clarity: fail
  - logical progression: fail (No question generated)
  - graph-backed: fail
  - premature-specialism avoided: fail

## Failure Pattern Analysis

### Start Phase
- **5/6 succeeded**, 1/6 failed
  - scenario-6: Scenario analysis failed

### Update Phase
- **0/6 succeeded**, 5/6 failed, 1/6 skipped

- **N/A** (5 failures):
  - scenario-1: Invalid update-case request
  - scenario-2: Invalid update-case request
  - scenario-3: Invalid update-case request
  - scenario-4: Invalid update-case request
  - scenario-5: Invalid update-case request

## What's Stable

- ✅ **Graph construction**: 5/6 start success across all scenario types (commercial, operational, personal, policy)

## Recommendations

1. **Fix update failures** (5/6): Primary focus area. Most failures in proposal_compatibility and delta detection.
- Monitor reasoning pattern inference reliability across different scenario domains.
- Consider adding timeout guards for long-running LLM calls (some exceeded 60s).