Commit Graph
486 Commits
Author SHA1 Message Date
robbond a476431048 docs: record uncertainty identity clarification 2026-08-11 17:47:45 +01:00
robbond b8e6745c15 prompt: distinguish uncertainty identity from topical overlap 2026-08-11 17:47:12 +01:00
robbond f0cf85d2b6 experiment: diagnose uncertainty identity vs relatedness 2026-08-11 17:41:23 +01:00
robbond 19c00f3bf3 experiment: test structured-fidelity multi-turn progress 2026-08-11 17:34:54 +01:00
robbond 5947ccb642 experiment: validate structured semantic fidelity live 2026-08-11 17:18:59 +01:00
robbond f156bf5ef8 docs: record structured semantic fidelity implementation 2026-08-11 16:46:30 +01:00
robbond 7d06cd3c47 reasoning: use structured semantic fidelity contract 2026-08-11 16:45:00 +01:00
robbond b6a232ff6f experiment: choose structured fidelity migration 2026-08-11 16:17:55 +01:00
robbond f330421294 experiment: assess structured semantic fidelity boundary
- Experiment 57J.49: read-only architecture diagnosis showing EXISTING STRUCTURE IS PARTIAL
- All classification enums (supportCategory) and resolution enums (resolutionGuidance) already exist in production schema
- Gap is population (prompt says leave null if unsure) + enforcement (no enum constraint on Zod fields)
- Corrected 57J.48 overstatement of SUFFICIENT → PARTIAL sufficiency in handoff
2026-08-11 15:04:47 +01:00
robbond a2c790ee80 experiment: diagnose uncertainty fidelity false positive 2026-08-11 14:56:15 +01:00
robbond 174e581c23 experiment: convergence-test uncertainty action selection 2026-08-11 14:35:50 +01:00
robbond 94ca1b92f7 docs: experiment 57J.46 record and handoff update 2026-08-11 14:15:50 +01:00
robbond a5dd9d3f1a prompt: add existing-first uncertainty fallback
Add one explicit action-order rule in Additional Guidance for when
rule #6 applies to explicitly unresolved uncertainty:

1. First check whether an existing unresolved node already represents
   the same uncertainty.
2. If so, update/refine that existing structure rather than creating
   a duplicate.
3. If no such node exists, add a new unknown that directly represents
   the unresolved uncertainty.
4. Do not use an edge alone to represent a previously unrepresented
   uncertainty.

14 focused prompt tests verify: existing-first ordering, reuse path,
fallback-to-add, related-node-insufficient, edge-only-prohibited,
possibleInference separation, resolution path preserved, duplicate
contract preserved, scope uncertainty-only, fidelity/traceability
preserved, noop validator untouched, no semantic classifier added.
2026-08-11 14:12:42 +01:00
robbond 96b855b8e7 experiment: choose structural action-selection rule 2026-08-11 14:01:42 +01:00
robbond acd1928ebb experiment: validate conflict-free mutation prompt live 2026-08-11 13:36:03 +01:00
robbond 45d7b96827 docs: experiment 57J.43 record and handoff update 2026-08-11 13:23:14 +01:00
robbond 359ccc4ba9 prompt: remove semantic-only mutation conflict 2026-08-11 13:22:29 +01:00
robbond 0c477adea9 experiment: diagnose structural-mutation prompt compliance 2026-08-11 13:15:27 +01:00
robbond 6aea0bd90c experiment: isolate semantic-to-mutation contract live 2026-08-11 13:09:51 +01:00
robbond 39217b6b65 experiment: validate semantic-to-mutation contract live 2026-08-11 13:01:54 +01:00
robbond 712c0c4998 docs: experiment 57J.39 record and handoff update 2026-08-11 12:32:39 +01:00
robbond 6adcd817e1 reasoning: require structural progress for supported meaning 2026-08-11 12:32:03 +01:00
robbond 3b868b266e experiment: choose semantic-to-mutation contract fix 2026-08-11 12:03:16 +01:00
robbond 77f5ea26d4 experiment: locate semantic-to-mutation contract gap 2026-08-11 11:56:36 +01:00
robbond b341c9cf2f experiment: rerun guarded multi-turn progress cleanly 2026-08-11 11:41:51 +01:00
robbond 4998de54d2 tooling: enforce no-retry live experiment harness 2026-08-11 11:32:19 +01:00
robbond 06f67da1b4 experiment: observe guarded multi-turn progress 2026-08-11 10:50:05 +01:00
robbond bda3abf893 experiment: classify captured answer-meaning strengthening 2026-08-11 10:19:19 +01:00
robbond a00f7b170d experiment: inspect rejected proposal live variance 2026-08-11 10:03:35 +01:00
robbond 48e9bcf3eb docs: add Experiment 57J.31 entry to handoff 2026-08-11 08:34:51 +01:00
robbond 0348921542 experiment: add rejected proposal diagnostics to failure path
Adds rejectedProposalSnapshot to orchestrator diagnostics for
proposal_compatibility rejections — exposing answerMeaning (userSupportedMeaning,
possibleInference), addedNodes structural fields, addedEdges structural fields,
updatedNodes summaries, and resolvedUnknownNodeIds. Diagnostic evidence only;
does not alter validation, mutation, or error messages. Stage-gated to
proposal_compatibility only.
2026-08-11 08:33:36 +01:00
robbond 79377670e2 experiment: capture proposal-boundary live variance 2026-08-11 08:19:21 +01:00
robbond 1c15b2b123 experiment: measure live semantic representation stability 2026-08-11 07:36:21 +01:00
robbond 25f56d75e2 experiment: capture live node-support semantic inputs 2026-08-11 07:12:30 +01:00
robbond d5db3c3cd6 experiment: observe post-admission investigation progress 2026-08-11 06:56:35 +01:00
robbond fbbd271596 experiment: validate user-supported unknown admission live 2026-08-11 06:38:30 +01:00
robbond 2e20d30890 correction: delegate hasNodeLevelUserSupport to rawAnswerSupportsUnclassifiedMeaning
v0.15 duplicated the overlap helper logic in hasNodeLevelUserSupport with
reversed argument orientation (unknownText as source, userSupportedMeaning
as candidate) compared to rawAnswerSupportsUnclassifiedMeaning (USM as
source, unknownText as candidate). This produced different accept/reject
outcomes when the two texts have very different token counts.

The fix replaces the independent reconstruction with a single call to the
canonical helper, ensuring node-level and answer-meaning alignment use
identical semantics. Four boundary regression tests verify:

- Boundary A: overlap ratio < 0.4 but >= 3 shared tokens → accept (token rule)
- Boundary B: short candidate / long source accepted via structural linkage
- Boundary B control: unrelated unknown rejected with no structural edge
- Boundary C: ratio exactly at 0.4 threshold accepts via ratio rule
2026-08-10 20:09:39 +01:00
robbond 9e869cbcb8 reasoning: admit verified user-supported unknowns without provenance edges 2026-08-10 19:27:54 +01:00
robbond 1fe3cec4bd experiment: observe live unknown dimensionality representation 2026-08-10 15:41:49 +01:00
robbond 15f2433151 docs: record rejected answerability corroboration candidate 2026-08-10 15:08:23 +01:00
robbond 0d15dd1f42 Revert "reasoning: require corroboration for conjunction compoundness"
This reverts commit 60048a5636.
2026-08-10 15:07:30 +01:00
robbond 60048a5636 reasoning: require corroboration for conjunction compoundness 2026-08-10 14:53:57 +01:00
robbond dcefb36f4d experiment: capture minimal clarification answerability 2026-08-10 14:26:07 +01:00
robbond 90e662397f experiment: validate relationship fallback live 2026-08-10 13:10:21 +01:00
robbond 4c5666dfb3 reasoning: suppress explanation question without relationship structure 2026-08-10 10:17:35 +01:00
robbond 1a31949a48 experiment: validate semantic compatibility live 2026-08-10 08:46:31 +01:00
robbond 69efc5d1b9 reasoning: ground unclassified answers without category expansion 2026-08-10 08:20:00 +01:00
robbond 4ea664d0d8 experiment: validate decomposition relevance live 2026-08-10 08:04:59 +01:00
robbond 7e4c506614 reasoning: prevent unsupported comparison decomposition 2026-08-10 07:44:40 +01:00
robbond 513c483501 experiment: locate irrelevant decomposition question boundary 2026-08-10 07:19:52 +01:00