Commit Graph
979 Commits
Author SHA1 Message Date
Paul Bakaus efa2ce9ed2 Preserve failed Live benchmark evidence
AI-assisted implementation under maintainer direction.
2026-07-13 12:43:45 -07:00
Paul Bakaus 6e92da3ba5 Cut Live first review latency
AI-assisted implementation under maintainer direction.
2026-07-13 12:43:36 -07:00
Paul BakausandClaude Fable 5 62ee3a9b00 a17: colored space, derived composition, subtraction, incumbent-as-evidence
Four lines from the r10 dual consultation (codex gpt-5.6-sol + gemini
3.5-pro on the actual HTMLs) and the hero-probe micro-eval: the probe
isolated a first-viewport monoculture (same split template in every
sample, control and skill alike) and showed these lines break it while
codex's raw 15-liner alone does not. The incumbent sentence swap fixes
the r10 root cause both consultants independently identified.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 12:41:34 -07:00
Paul Bakaus dd928f81d4 Fix Live Lab prose validation 2026-07-13 12:17:36 -07:00
Paul Bakaus 0c255e6c2a Record Live delta and standby evidence 2026-07-13 12:11:44 -07:00
Paul Bakaus 7a3ef022d9 Cut Live variant two output latency 2026-07-13 12:09:39 -07:00
Paul Bakaus 265502a125 Update Live Lab checkpoint evidence 2026-07-13 11:48:05 -07:00
Paul Bakaus 4c07124198 Deliver Live variant two independently 2026-07-13 11:42:25 -07:00
Paul Bakaus 2f619f9bdb Prove Live benchmark target selection 2026-07-13 11:22:43 -07:00
Paul Bakaus eedccaedb0 Add durable Live variant planning 2026-07-13 11:22:26 -07:00
Paul Bakaus 49bff8da75 Improve Live variant quality guardrails 2026-07-13 11:05:30 -07:00
Paul Bakaus d293b803d0 Calibrate Live rendered quality review 2026-07-13 11:05:13 -07:00
Paul Bakaus 0ee3e80aec Register Live Codex test coverage
AI-assisted: Codex
2026-07-13 10:52:55 -07:00
Paul Bakaus e6d1206c45 Update Live Lab production evidence
AI-assisted: Codex
2026-07-13 10:47:44 -07:00
Paul Bakaus c6dfd22329 Harden Live worker recovery
AI-assisted: Codex
2026-07-13 10:44:37 -07:00
Paul Bakaus a274f93c4e Add atomic Live benchmark controls
AI-assisted: Codex
2026-07-13 10:43:21 -07:00
Paul Bakaus e9121b26fe Harden Live production benchmarks and turn failures
AI-assisted: Codex
2026-07-13 10:19:42 -07:00
Paul Bakaus db63d08168 Detach canceled Live generation tails
AI-assisted: Codex
2026-07-13 10:08:27 -07:00
Paul Bakaus 2008381e91 Improve Live worker recovery and Accept latency
AI-assisted: Codex
2026-07-13 09:56:48 -07:00
Paul Bakaus 8a6c4ab486 Fix early Live choice queue ownership
AI-assisted: Codex
2026-07-13 09:54:23 -07:00
Paul Bakaus 78b1b5878d Add rendered Live quality evidence
AI-assisted: Codex
2026-07-13 09:51:21 -07:00
Paul Bakaus 22786feac0 Record annotated and warm-cache evidence
Add repeated production annotation timing, real app-server cache telemetry, the context-delta decision, and correct --judge=false handling.\n\nAI-assisted: OpenAI Codex.
2026-07-12 21:22:27 -07:00
Paul Bakaus 1e4927d86a Prevent duplicate long-running Live turns
Keep short crash-recovery leases without allowing a healthy worker to queue its own generation twice, and surface non-monotonic benchmark journals as errors.\n\nAI-assisted: OpenAI Codex.
2026-07-12 21:18:20 -07:00
Paul Bakaus 960f4b725b Show Codex Live prewarm timing
Distinguish the 87 ms non-blocking Live return from the 657 ms worker-ready milestone in the developer dashboard.\n\nAI-assisted: OpenAI Codex.
2026-07-12 21:15:56 -07:00
Paul BakausandClaude Fable 5 79573ce55b refinement scope: keep content + media footprint; recompose for emphasis (codex+gemini consult)
Replaces the a14/a15 attempts (both deleted). Diagnosis: incentive
stacking; the placeholder-completion MUST plus the image tool turned
'bolder' into full-bleed photo insertion. Scope preservation is the
missing rule, not imagery policy.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 21:13:58 -07:00
Paul Bakaus 6ed43ca682 Prewarm Codex Live with safe fallback
Return after a durable starting record, overlap app-server initialization with page startup, dynamically reclaim generation after worker failure, and cap hard-crash leases at 15 seconds.\n\nAI-assisted: OpenAI Codex.
2026-07-12 21:11:50 -07:00
Paul BakausandClaude Fable 5 6f3076051f persuade: scope the imagery MUST to new surfaces; existing systems decide their own vocabulary
x02 a14 rerun: 3/3 samples still imported photos — the unscoped MUST in
the Persuade mode block overrode the existing-worlds principle. Scoping
keeps the greenfield ablation win, frees iteration asks.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 21:09:58 -07:00
Paul Bakaus 6bb79f0af4 Clarify Live Lab architecture decisions
Remove stale and contradictory experiments, order the surviving decisions by impact, and replace synthetic claims with current production evidence.\n\nAI-assisted: OpenAI Codex.
2026-07-12 21:02:17 -07:00
Paul Bakaus 753820f25b Show real Codex Live loop evidence
Replace stale startup and synthetic claims with production browser timing, matched architecture comparisons, Accept latency, and honest run counts.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:59:38 -07:00
Paul BakausandClaude Fable 5 5674a94114 existing-worlds: boldness from committed materials; new medium = redesign, not refinement
x02-tidewater-bolder eval: 3/3 skill-on samples imported photography into
a photo-free seed system (0% arena vs competitor, which amplified the
seed's own vocabulary instead). One sentence, shape-level, no examples.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 20:59:07 -07:00
Paul Bakaus 833deeef16 Fix first-variant benchmark scope
Count variants only inside the active generation wrapper so deferred carbonize markers cannot create false fast-path results.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:57:00 -07:00
Paul Bakaus 46d4fc4877 Measure Accept-to-next-generation latency
Exercise accepting the first progressive variant, immediately preparing another task, and receiving its first result through the independent Codex worker.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:55:00 -07:00
Paul Bakaus 10183bd91c Measure production Live worker phases
Trace worker pickup and derive generation, validation, and publication latency from the durable Live session journal.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:52:34 -07:00
Paul Bakaus aba1067cdf Benchmark the production Codex Live worker
Let the browser E2E harness launch an independent production worker, exercise real sub-command selection, and carry realistic product/design context.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:50:28 -07:00
Paul Bakaus edde928736 Capture Codex worker token usage
Record per-turn app-server token notifications so Live architecture benchmarks can compare context and cache costs.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:47:01 -07:00
Paul Bakaus 27bbf90ede Improve Codex Live architecture benchmark
Compare production-equivalent direct and app-server paths, include annotated UI work, expose first-usable latency, and keep semantic quality gates honest.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:46:53 -07:00
Paul Bakaus 395953ae1d Publish app-server output before turn completion
Validate and transactionally publish complete structured agent messages as soon as they arrive while retaining turn-completion serialization for subsequent phases.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:31:30 -07:00
Paul Bakaus 0aa6fc56a0 Show Codex Live generation progress
Journal and stream dedicated worker phases so Live distinguishes first-variant design and validation from remaining-direction work without adding pollable events.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:21:22 -07:00
Paul Bakaus 27a210b04c Add Codex Live architecture benchmark
Compare direct Sol execution with cold and persistent app-server paths using identical full-task quality gates, lifecycle timings, and token metrics.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:19:23 -07:00
Paul Bakaus 2a6f8c3f53 Publish Codex Live quality evidence
Update Live Lab and the Live reference with the default Sol worker, full-task quality gate, Spark control, cold readiness, and production architecture.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:05:28 -07:00
Paul BakausandClaude Fable 5 b6304913ef detector: narrow the tab-strip stripe exemption to actual selection state
Tab-strip MEMBERSHIP no longer exempts chromatic top/bottom stripes —
only a real selection marker does: aria-selected="true", aria-current
(any non-false value), or an active/current/selected class hint. A
stripe repeated on every tab in the group ([role=tab], .tabs items,
aria-selected="false" tabs) is decoration and flags as side-tab; the
selected tab's own underline — including the reserved-space
transparent-border pattern — stays legal. Applied consistently across
the element border path (isTabContextElement), the pseudo-element
stripe scan, and the inset box-shadow stripe scan.

Also replaces a stray NUL byte in the marquee scanner's dedupe key
that made tools treat checks.mjs as binary.

Browser bundle regenerated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 20:04:22 -07:00
Paul Bakaus 5e1925f9d2 Handle empty Codex worker shutdown
Treat a never-used app-server thread with no rollout file as already archived while retaining real archive failures.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:04:19 -07:00
Paul Bakaus 421c1a93f5 Harden Live design-system fidelity
Route the full-context benchmark through production worker inputs and preserve established shared-control visual roles during variant amplification.\n\nAI-assisted: OpenAI Codex.
2026-07-12 20:02:44 -07:00
Paul Bakaus f814dd329e Enable the Codex Live quality worker
Default Codex to a dedicated Sol/medium app-server worker with native skill and image inputs, inherited project context, bounded source neighborhood evidence, and progressive context refresh. Other harnesses retain the portable foreground path.\n\nAI-assisted: OpenAI Codex.
2026-07-12 19:57:47 -07:00
Paul Bakaus 6d1bd40959 Fix Codex quality benchmark gates
Allow valid CSS-only design work and compare JSX component contracts independent of formatting.\n\nAI-assisted: OpenAI Codex.
2026-07-12 19:53:42 -07:00
Paul Bakaus 92a5589d5d Add Codex Live quality benchmark
Benchmark realistic bolder and polish tasks across fast, full-model, and full-context worker profiles with deterministic and independent quality gates.\n\nAI-assisted: OpenAI Codex.
2026-07-12 19:48:51 -07:00
Paul Bakaus e89645e69d Add experimental Codex Live worker
Introduce a Live-owned app-server supervisor with progressive fenced publishing, partitioned control polling, cancellation and recovery safety, and measured integration coverage.

AI-assisted implementation under maintainer direction.
2026-07-12 19:14:05 -07:00
Paul Bakaus ee50f70d79 Improve Live UI state inspector
AI-assisted: implemented and validated with Codex.
2026-07-12 18:52:07 -07:00
Paul Bakaus a22053b818 Clarify the Live Lab workbench
AI-assisted: OpenAI Codex.
2026-07-12 18:49:00 -07:00
Paul BakausandClaude Fable 5 f690785c3e docs: 49 deterministic rules (radial-halo, marquee)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 18:40:09 -07:00