conformance: exclude forth (foreign Forth corpus via awk+python preprocessing)
Some checks failed
Test, Build, and Deploy / test-build-deploy (push) Failing after 40s

forth's conformance.sh reads a foreign Forth test corpus (Hayes Core core.fr),
preprocesses it with awk + an external python3 chunk-splitter that generates a
chunks.sx of raw source strings, then runs them through the interpreter via
(hayes-run-all). The shared driver only epoch-loads SX preloads and evals SX
test suites emitting a counter/dict scoreboard — it cannot reproduce the
external preprocessing pipeline over a foreign .fr corpus (same category as
lua/smalltalk). No SX tests/*.sx suites exist to migrate. Left conformance.sh
untouched; recorded the exclusion.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-06-07 11:11:49 +00:00
parent b4ecadaad9
commit 4b31828641

View File

@@ -88,7 +88,7 @@ Blocked with specifics and move to the next candidate next iteration.
- [x] common-lisp — migrated 487/487 (counters; driver extended for per-suite counters+preloads) - [x] common-lisp — migrated 487/487 (counters; driver extended for per-suite counters+preloads)
- [x] erlang — migrated 761/761 (dict; pass/count → :failed = count-pass) - [x] erlang — migrated 761/761 (dict; pass/count → :failed = count-pass)
- [x] feed — migrated 189/189 (counters; test-harness.sx preload for counters+helper) - [x] feed — migrated 189/189 (counters; test-harness.sx preload for counters+helper)
- [ ] forth - [~] forth — excluded: foreign Forth corpus (Hayes core.fr) via awk+python preprocessing
- [ ] go - [ ] go
- [ ] js - [ ] js
- [ ] ocaml - [ ] ocaml
@@ -100,6 +100,14 @@ Blocked with specifics and move to the next candidate next iteration.
## Progress log (newest first) ## Progress log (newest first)
- 2026-06-07 — forth: EXCLUDED (foreign-runner, like lua/smalltalk). Its conformance.sh
reads a foreign Forth corpus (lib/forth/ans-tests/core.fr, the gerryjackson Hayes Core
suite), preprocesses it with awk (strip `\` / `( )` comments + TESTING lines), splits it
into `}T` chunks via an external python3 script that generates a chunks.sx of raw source
strings, then runs them through the interpreter via (hayes-run-all) → {:pass :fail :error
:total}. The shared driver only epoch-loads SX preloads + evals SX test suites; it can't
reproduce the awk+python preprocessing of a foreign .fr corpus. No SX `tests/*.sx` suites
exist to point the driver at. Left conformance.sh untouched. Not migrated.
- 2026-06-07 — feed: migrated to `MODE=counters`, 189/189 exact parity (basic 30, - 2026-06-07 — feed: migrated to `MODE=counters`, 189/189 exact parity (basic 30,
fanout 29, rank 24, integration 22, content 15, notify 8, home 6, dedupe 9, trending 11, fanout 29, rank 24, integration 22, content 15, notify 8, home 6, dedupe 9, trending 11,
mute 9, page 14, thread 12). Canonical counters shape: fresh session per suite, shared mute 9, page 14, thread 12). Canonical counters shape: fresh session per suite, shared