From 31603e636ba073843eef077777b809847a1d24f5 Mon Sep 17 00:00:00 2001 From: giles Date: Sun, 7 Jun 2026 12:42:44 +0000 Subject: [PATCH] conformance: exclude smalltalk (scrapes test.sh + foreign *.st corpus) smalltalk conformance.sh catalogs foreign lib/smalltalk/tests/programs/*.st programs, runs 'bash lib/smalltalk/test.sh -v', and scrapes its output (the 'OK 403/403' summary plus per-file pass counts via awk). It loads no SX test suites directly and emits no SX counter/dict scoreboard. This is the briefing's own classification example ('smalltalk runs *.st via test.sh') and the same 'scrapes a test.sh' exclusion as ocaml/lua. Left conformance.sh untouched; recorded the exclusion. Co-Authored-By: Claude Opus 4.8 (1M context) --- plans/agent-briefings/conformance-loop.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/plans/agent-briefings/conformance-loop.md b/plans/agent-briefings/conformance-loop.md index a745742e..4d5a4ef0 100644 --- a/plans/agent-briefings/conformance-loop.md +++ b/plans/agent-briefings/conformance-loop.md @@ -92,7 +92,7 @@ Blocked with specifics and move to the next candidate next iteration. - [x] go — migrated 609/609 (dict; pass/count → :failed = count-pass, like erlang) - [~] js — excluded: foreign test262 .js fixtures vs .expected files (python escape, substring match) - [~] ocaml — excluded: scrapes lib/ocaml/test.sh (per-assertion epoch runner) + foreign .ml baseline -- [ ] smalltalk +- [~] smalltalk — excluded: scrapes lib/smalltalk/test.sh + walks foreign *.st corpus (per briefing) - [ ] tcl (Mark `[x] — migrated N/N` or `[~] — excluded: ` or @@ -100,6 +100,13 @@ Blocked with specifics and move to the next candidate next iteration. ## Progress log (newest first) +- 2026-06-07 — smalltalk: EXCLUDED (the briefing's own classification example — + "smalltalk runs *.st via test.sh"). conformance.sh catalogs foreign + lib/smalltalk/tests/programs/*.st programs, runs `bash lib/smalltalk/test.sh -v`, and + scrapes its output (final "OK 403/403" summary + per-file pass counts via awk). It loads + no SX test suites directly and emits no SX counter/dict scoreboard — the bash layer + derives all numbers by text-scraping test.sh. Same "scrapes a test.sh" exclusion as + ocaml/lua. Left conformance.sh untouched. Not migrated. - 2026-06-07 — ocaml: EXCLUDED (scrapes a test.sh — the briefing's named exclusion criterion). conformance.sh runs `bash lib/ocaml/test.sh -v`, scrapes its human-readable ok/FAIL lines, and re-classifies each test into suites via bash description-matching