garrytan e7c11039ea eval policy v3: judge panels gate on the per-dimension median of 3 samples ...

A judge dimension now passes when at least 2 of its 3 samples meet the
unchanged threshold (judgePanelMedian); any other sample count or a
non-numeric sample fails closed. Thresholds, sample count, judge model and
prompts are unchanged; panel logs show every sample and the mean, and name
the median as the gate. Applies to the skill-llm-eval panels, the
workflow-judge cache, the auq-matrix substance panel and the calibration
replicas. EVAL_POLICY 2 -> 3 and HARNESS_VERSION 1 -> 2 (verdicts change),
so every case starts a new pass-rate series. Replays the captured panels
from jobs 112032744416 and 112049856586 as replayed evidence.

2026-10-06 17:43:29 +00:00

..

app

feat: GStack Browser — double-click AI browser with anti-bot stealth (#695)

2026-04-04 10:17:05 -07:00

lib

fix: --case runs a single-case file whole

2026-10-05 17:23:34 +00:00

resolvers

fix(skills): resolve judge-cited ambiguities in /qa and /plan-eng-review

2026-10-06 00:19:36 +00:00

ubicloud

Bun 1.4.2 everywhere CI and setup pin the tested version

2026-10-05 14:16:02 +00:00

analytics.ts

v1.91.11.0 refactor: one state-root rule, browse route table, shared shard engine, PTY harness split, MECE review resolvers (#3002)

2026-10-01 11:57:48 -07:00

archetypes.ts

feat: gstack v1 — simpler prompts + real LOC receipts (v1.0.0.0) (#1039)

2026-04-18 15:05:42 +08:00

brain-cache-spec.ts

v1.91.8.0 test: smaller suite, derived paid selection, retired never-green evals (#2994)

2026-09-29 08:58:49 -07:00

build-app.sh

v1.69.0.0 fix: the silent-failure wave — 6 fixes, 5 community PRs absorbed, tracker closed with receipts (#2666)

2026-08-24 08:55:58 -07:00

build-cso-windows.ps1

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

build-cso.sh

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

build.sh

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

bump-harness-version.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

capture-baseline.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

compare-pr-version.ts

v1.16.0.0 feat: tunnel allowlist 17→26 + canDispatchOverTunnel pure function (#1253)

2026-04-28 00:57:28 -07:00

cso-attestation-evidence.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-eval-producer.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-eval-protocol.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-eval.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-image-matrix.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-native-evidence.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-public-ghcr.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-requalification.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-runtime-promotion.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-sbom-packages-check.jq

v1.91.27.0 fix(cso): runtime staging can finish and a qualified scanner catalog can ship (#3041)

2026-10-05 10:00:47 -07:00

cso-sbom-packages.jq

v1.91.27.0 fix(cso): runtime staging can finish and a qualified scanner catalog can ship (#3041)

2026-10-05 10:00:47 -07:00

cso-scanner-catalog.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-scanner-matrix.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-staging-run.ts

v1.91.25.0 feat(cso): private two-architecture release scoring + self-checking runtime release gates (#3036)

2026-10-04 21:47:21 -07:00

cso-verify-runtime-base.ts

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

declared-annotation.ts

v1.91.11.0 refactor: one state-root rule, browse route table, shared shard engine, PTY harness split, MECE review resolvers (#3002)

2026-10-01 11:57:48 -07:00

detect-bump.ts

v1.11.0.0 feat(ship): workspace-aware version allocation (#1168)

2026-04-23 23:03:27 -07:00

dev-skill.ts

v1.57.9.0 feat: source-clean gbrain render (dev-setup --out-dir + machine-wide gbrain-refresh) (#1951)

2026-06-09 22:29:23 -07:00

discover-skills.ts

v1.87.6.0 fix: make checks reliable and everyday validation faster (#2898)

2026-09-22 14:57:52 -04:00

e2e-shard-reuse.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-bg.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-compare.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-flake-rank.ts

Merge remote-tracking branch 'origin/main' into garrytan/reliability-followups-oct4

2026-10-05 01:42:55 +00:00

eval-input-cache.ts

v1.91.12.0 v1.91.12.0: audit fix wave, ~11-minute paid eval lanes, eval reliability policy (#2999)

2026-10-01 13:55:16 -07:00

eval-list.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-select.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-summary.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

eval-trial-series.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

external-skill-names.ts

v1.91.2.0 fix: consolidate gstack reliability wave (#2959)

2026-09-26 18:57:53 -04:00

free-test-durations-windows.json

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

free-test-durations.json

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

free-test-seed-allowlist.json

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

garry-output-comparison.ts

fix: remove hardcoded author emails from throughput script

2026-04-18 15:36:50 +08:00

gen-agents-digest.ts

v1.75.0.0 feat: ponytail import wave — simplification review lens, arm benchmark, reuse ladder, instruction-tier digest (#2722)

2026-08-29 10:10:35 -07:00

gen-llms-txt.ts

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

gen-skill-docs.ts

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

gstack-schema-pack.ts

v1.52.1.0 feat: brain-aware planning — 5 skills read structured gbrain context before asking (#1742)

2026-05-29 08:35:00 -07:00

harness-version.json

eval policy v3: judge panels gate on the per-dimension median of 3 samples

2026-10-06 17:43:29 +00:00

host-config-export.ts

v1.64.1.0 v1.64.1.0: the code-smell fix wave — every pipeline guard now provably fires (net −24,943 lines) (#2572)

2026-08-15 09:37:04 -07:00

host-config.ts

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

jargon-list.json

feat: gstack v1 — simpler prompts + real LOC receipts (v1.0.0.0) (#1039)

2026-04-18 15:05:42 +08:00

judge-calibration-configs.ts

eval policy v3: judge panels gate on the per-dimension median of 3 samples

2026-10-06 17:43:29 +00:00

judge-calibration.ts

v1.91.18.0 feat: Opus 5.5 cleanup follow-ups — scoped transcript consent, opt-in Claude overlay, safety-rule evals, calibrated judges (#3023)

2026-10-03 18:49:34 -07:00

judge-controls.ts

eval policy v3: judge panels gate on the per-dimension median of 3 samples

2026-10-06 17:43:29 +00:00

models.ts

v1.91.18.0 feat: Opus 5.5 cleanup follow-ups — scoped transcript consent, opt-in Claude overlay, safety-rule evals, calibrated judges (#3023)

2026-10-03 18:49:34 -07:00

one-way-doors.ts

v1.61.0.0 fix wave: guards failing open / silent failures (9 fixes, 4 community PRs absorbed) (#2472)

2026-08-08 09:28:45 -07:00

paid-test-durations.json

Merge remote-tracking branch 'origin/main' into garrytan/reliability-followups-oct4

2026-10-05 01:42:55 +00:00

pr-dependencies.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

preflight-agent-sdk.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

preflight-codex-overlap.ts

v1.91.2.0 fix: consolidate gstack reliability wave (#2959)

2026-09-26 18:57:53 -04:00

prompt-audit-manifest.ts

v1.91.18.0 feat: Opus 5.5 cleanup follow-ups — scoped transcript consent, opt-in Claude overlay, safety-rule evals, calibrated judges (#3023)

2026-10-03 18:49:34 -07:00

psychographic-signals.ts

v1.91.12.0 v1.91.12.0: audit fix wave, ~11-minute paid eval lanes, eval reliability policy (#2999)

2026-10-01 13:55:16 -07:00

question-registry.ts

v1.91.13.0 fix: severe bug wave (autoplan guard, land-and-deploy CI gate, project identity, gbrain, review gates) (#3013)

2026-10-02 11:11:00 -07:00

recover-receipts.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

replay-pr-selection.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

resolve-codex-generation-model.ts

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

retired-command.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

sandbox-doctor.sh

v1.75.0.0 feat: ponytail import wave — simplification review lens, arm benchmark, reuse ladder, instruction-tier digest (#2722)

2026-08-29 10:10:35 -07:00

setup-scc.sh

feat: gstack v1 — simpler prompts + real LOC receipts (v1.0.0.0) (#1039)

2026-04-18 15:05:42 +08:00

skill-check.ts

v1.87.6.0 fix: make checks reliable and everyday validation faster (#2898)

2026-09-22 14:57:52 -04:00

slop-diff.ts

security: tunnel dual-listener + SSRF + envelope + path wave (v1.6.0.0) (#1137)

2026-04-21 21:58:27 -07:00

test-free-shards.ts

test: name the in-flight file and the native error when bun dies before its summary (#3037)

2026-10-05 02:59:45 +00:00

test-health-report.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

test-paid-shards.ts

fix: --case no longer deadlocks importing the running CLI

2026-10-05 02:56:12 +00:00

test-pr-profile.ts

v1.91.24.0 test: audit wave — PR evals keep finished work, honest ceilings, EVAL_POLICY v2, faster free suite (#3031)

2026-10-05 01:29:54 +00:00

test-strict-output.ts

v1.91.11.0 refactor: one state-root rule, browse route table, shared shard engine, PTY harness split, MECE review resolvers (#3002)

2026-10-01 11:57:48 -07:00

typecheck-test-baseline.json

fix(office-hours): reviewer returns a hash-bound receipt instead of echoing its verdict

2026-10-05 18:50:21 +00:00

typecheck-test.ts

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

write-version-files.sh

v1.42.0.0 Daegu wave: 23 community-filed bugs + PTY classifier enforcement (24 bisect commits) (#1594)

2026-05-20 07:35:01 -07:00