Files
rose-ash/plans/erlang-on-sx.md

44 KiB
Raw Blame History

Erlang-on-SX: actors on delimited continuations

The headline showcase for the SX runtime. Erlang is built around the one primitive — lightweight processes with mailboxes and selective receive — that delimited continuations implement natively. Most Erlang implementations ship a whole VM (BEAM) for this; on SX each process is a pair of continuations and the scheduler is ~50 lines of SX.

End-state goal: spawn a million processes, run the classic ring benchmark, plus a mini gen_server OTP subset and a test corpus of ~150 programs.

Scope decisions (defaults — override by editing before we spawn)

  • Syntax: Erlang/OTP 26 subset. No preprocessor, no parse transforms.
  • Conformance: not BEAM-compat. "Looks like Erlang, runs like Erlang, not byte-compatible." We care about semantics, not BEAM bug-for-bug.
  • Test corpus: custom — ring, ping-pong, fibonacci-server, bank-account-server, echo-server, plus ~100 hand-written tests for patterns/guards/BIFs. No ISO Common Test.
  • Binaries: basic bytes-lists only; full binary pattern matching deferred.
  • Distribution, NIFs: out of scope entirely.
  • Hot code reload (Phase 7): in scope — driven by fed-sx (section 17.5) which needs federated modules to be re-loaded without restarting the scheduler.
  • FFI BIFs (Phase 8): in scope — Erlang code needs crypto:hash, cid:from_bytes, file:read_file, httpc:request, sqlite:exec to participate in fed-sx. A general FFI BIF registry replaces today's hard-coded BIF dispatch.

Ground rules

  • Scope: only touch lib/erlang/** and plans/erlang-on-sx.md. Don't edit spec/, hosts/, shared/, lib/js/**, lib/hyperscript/**, lib/lua/**, lib/prolog/**, lib/forth/**, lib/haskell/**, lib/stdlib.sx, or lib/ root. Erlang primitives go in lib/erlang/runtime.sx.
  • SX files: use sx-tree MCP tools only.
  • Commits: one feature per commit. Keep ## Progress log updated and tick roadmap boxes.

Architecture sketch

Erlang source
    │
    ▼
lib/erlang/tokenizer.sx  — atoms, vars, tuples, lists, binaries, operators
    │
    ▼
lib/erlang/parser.sx     — AST: modules, functions with clauses, patterns, guards
    │
    ▼
lib/erlang/transpile.sx  — AST → SX AST (entry: erlang-eval-ast)
    │
    ▼
lib/erlang/runtime.sx    — scheduler, processes, mailboxes, BIFs

Core mapping:

  • Process = pair of delimited continuations (on-receive, on-resume) + mailbox list + pid + links
  • Scheduler = round-robin list of runnable processes; cooperative yield on receive
  • spawn = push a new process record, return its pid
  • send = append to target mailbox; if target is blocked on receive, resume its continuation
  • receive = selective — scan mailbox for first matching clause; if none, perform a suspend with the receive pattern; scheduler resumes when a matching message arrives
  • Pattern matching = SX case on tagged values; vars bind on match
  • Guards = side-effect-free predicate evaluated after unification
  • Immutable data = native
  • Links / monitors / exit signals = additional process-record fields, scheduler fires exit signals on death

Roadmap

Phase 1 — tokenizer + parser

  • Tokenizer: atoms (bare + single-quoted), variables (Uppercase/_-prefixed), numbers (int, float, 16#HEX), strings "...", chars $c, punct ( ) { } [ ] , ; . : :: ->62/62 tests
  • Parser: module declarations, -module/-export/-import attributes, function clauses with head patterns + guards + body — 52/52 tests
  • Expressions: literals, vars, calls, tuples {...}, lists [...|...], if, case, receive, fun, try/catch, operators, precedence
  • Binaries <<...>> — landed in Phase 6 (parser + eval + pattern matching)
  • Unit tests in lib/erlang/tests/parse.sx

Phase 2 — sequential eval + pattern matching + BIFs

  • erlang-eval-ast: evaluate sequential expressions — 54/54 tests
  • Pattern matching (atoms, numbers, vars, tuples, lists, [H|T], underscore, bound-var re-match) — 21 new eval tests; case ... of ... end wired
  • Guards: is_integer, is_atom, is_list, is_tuple, comparisons, arithmetic — 20 new eval tests; local-call dispatch wired
  • BIFs: length/1, hd/1, tl/1, element/2, tuple_size/1, atom_to_list/1, list_to_atom/1, lists:map/2, lists:foldl/3, lists:reverse/1, io:format/1-235 new eval tests; funs + closures wired
  • 30+ tests in lib/erlang/tests/eval.sx130 tests green

Phase 3 — processes + mailboxes + receive (THE SHOWCASE)

  • Scheduler in runtime.sx: runnable queue, pid counter, per-process state record — 39 runtime tests
  • spawn/1, spawn/3, self/013 new eval tests; spawn/3 stubbed with "deferred to Phase 5" until modules land; is_pid/1 + pid equality also wired
  • ! (send), receive ... end with selective pattern matching — 13 new eval tests; delimited continuations (shift/reset) power receive suspension; sync scheduler loop
  • receive ... after Ms -> ... timeout clause (use SX timer primitive) — 9 new eval tests; synchronous-scheduler semantics: after 0 polls once; after Ms fires when runnable queue drains; after infinity = no timeout
  • exit/1, basic process termination — 9 new eval tests; exit/2 (signal another) deferred to Phase 4 with links
  • Classic programs in lib/erlang/tests/programs/:
    • ring.erl — N processes in a ring, pass a token around M times — 4 ring tests; suspension machinery rewritten from shift/reset to call/cc + raise/guard
    • ping_pong.erl — two processes exchanging messages — 4 ping-pong tests
    • bank.erl — account server (deposit/withdraw/balance) — 8 bank tests
    • echo.erl — minimal server — 7 echo tests
    • fib_server.erl — compute fib on request — 8 fib tests
  • lib/erlang/conformance.sh + runner, scoreboard.json + scoreboard.md358/358 across 9 suites
  • Target: 5/5 classic programs + 1M-process ring benchmark runs — 5/5 classic programs green; ring benchmark runs correctly at every measured size up to N=1000 (33s, ~34 hops/s); 1M target NOT met in current synchronous-scheduler architecture (would take ~9h at observed throughput). See lib/erlang/bench_ring.sh and lib/erlang/bench_ring_results.md.
  • link/1, unlink/1, monitor/2, demonitor/117 new eval tests; make_ref/0, is_reference/1, refs in =:=/format wired
  • Exit-signal propagation; trap_exit flag — 11 new eval tests; process_flag/2, monitor {'DOWN', ...}, {'EXIT', From, Reason} for trap-exit links, cascade death without trap_exit
  • try/catch/of/end19 new eval tests; throw/1, error/1 BIFs; nocatch re-raise wrapping for uncaught throws

Phase 5 — modules + OTP-lite

  • -module(M). loading, M:F(...) calls across modules — 10 new eval tests; multi-arity, sibling calls, cross-module dispatch via er-modules registry
  • gen_server behaviour (the big OTP win) — 10 new eval tests; counter + LIFO stack callback modules driven via gen_server:start_link/call/cast/stop
  • supervisor (simple one-for-one) — 7 new eval tests; trap_exit-based restart loop; child specs are {Id, StartFn} pairs
  • Registered processes: register/2, whereis/112 new eval tests; unregister/1, registered/0, Name ! Msg via registered atom; auto-unregister on death

Phase 6 — the rest

  • List comprehensions [X*2 || X <- L]12 new eval tests; generators, filters, multiple generators (cartesian), pattern-matching gens ({ok, V} <- ...)
  • Binary pattern matching <<A:8, B:16>>21 new eval tests; literal construction, byte/multi-byte segments, Rest/binary tail capture, is_binary/1, byte_size/1
  • ETS-lite (in-memory tables via SX dicts) — 13 new eval tests; ets:new/2, insert/2, lookup/2, delete/1-2, tab2list/1, info/2 (size); set semantics with full Erlang-term keys
  • More BIFs — target 200+ test corpus green — 40 new eval tests; 530/530 total. New: abs/1, min/2, max/2, tuple_to_list/1, list_to_tuple/1, integer_to_list/1, list_to_integer/1, is_function/1-2, lists:seq/2-3, lists:sum/1, lists:nth/2, lists:last/1, lists:member/2, lists:append/2, lists:filter/2, lists:any/2, lists:all/2, lists:duplicate/2

Phase 7 — hot code reload

Driven by fed-sx (see plans/fed-sx-design.md §17.5): federated modules must be replaceable at runtime without bouncing the scheduler. Classic OTP behaviour: two versions per module ("current" and "old"), local calls stick to the version the process started with, cross-module (M:F(...)) calls always resolve to the current version, and purge kills any process still running old code.

  • Module version slot: er-modules entry becomes {:current MOD-ENV :old MOD-ENV-or-nil :version INT}; bump version on each load — 13 new runtime tests (543/543 total)
  • code:load_binary/3 (the canonical reload BIF) — re-parses module source, swaps :current:old, installs new env as :current; returns {module, Name} or {error, Reason} (badarg / badfile / module_name_mismatch). +8 eval tests (551/551 total). code:load_file/1 is a thin filesystem wrapper around this and lands once file:read_file/1 is in (Phase 8).
  • code:purge/1 + code:soft_purge/1 — purge clears :old slot and kills any process whose :initial-fun env identity matches the old env (returns true if there was old code, false if there wasn't). soft_purge: refuses (returns false, leaves :old intact) if any process is still pinned to the old env; otherwise clears and returns true. +10 eval tests (561/561 total). Caveat: a true "lingering on old code" test needs spawn/3 (still stubbed) or fun M:F/A syntax (not parsed) — anonymous fun () -> M:F() end closures capture the caller's env, not the module's, and cross-module calls always resolve to :current. Current tests therefore exercise the return-value matrix but not the kill path.
  • code:which/1, code:is_loaded/1, code:all_loaded/0 — introspection. +10 eval tests (571/571 total). Return-value contract: whichloaded / non_existing (since we have no filesystem path); is_loaded{file, loaded} / false; all_loaded → list of {Module, loaded} tuples. Non-atom Mod raises error:badarg.
  • Cross-module call M:F(...) dispatches to :current; local calls inside a module body keep using the env they closed over so a running process finishes its current function with the version it started with — +6 eval tests verifying the property end-to-end (577/577 total). No implementation change: er-apply-user-module already routes through er-module-current-env, and er-mk-fun captures its env by reference so closures created under v1 retain v1's mod-env even after the slot bumps to v2.
  • Tests: load v1 → spawn → load v2 → cross-module call hits v2 → local call inside v1 process keeps v1 semantics until function returns → purge kills v1 procs → soft_purge refuses while v1 procs alive

Phase 8 — FFI BIF mechanism + standard libs

Replace today's hardcoded BIF dispatch (er-apply-bif/er-apply-remote-bif in transpile.sx) with a runtime-extensible BIF registry. Each registry entry is {:module :name :arity :fn :pure?}. Standard libs are then registered at boot, and fed-sx can register new BIFs from .sx files. Includes the marshalling layer (Erlang term ↔ SX value) so wrappers stay one-liners.

  • BIF registry: er-bif-registry global dict keyed by "Module/Name/Arity", with er-register-bif!/er-lookup-bif/er-list-bifs helpers
  • Migrate existing local + remote BIFs (length/hd/tl/lists:/io:format/ets:/etc.) onto the registry; delete the giant cond dispatch in er-apply-bif/er-apply-remote-bif. Conformance must stay 530/530 after migration
  • Term-marshalling helpers: er-of-sx and er-to-sx (atom ↔ symbol, tuple ↔ list-of-elements, Erlang list ↔ SX list, binary ↔ string, dict ↔ map). Round-trip tests
  • crypto:hash/2sha256, sha512, blake3; takes a binary, returns a binary. Uses the SX-host hash primitive
  • cid:from_bytes/1, cid:to_string/1 — content-address an arbitrary binary
  • file:read_file/1, file:write_file/2, file:list_dir/1, file:delete/1 — sync filesystem ops returning {ok, Bin} / {error, Reason}
  • httpc:request/4 — synchronous HTTP GET/POST, returns {ok, {Status, Headers, Body}} / {error, Reason}
  • sqlite:open/1, sqlite:close/1, sqlite:exec/2, sqlite:query/2 — single-process SQLite handle pool keyed by filename
  • Tests: 1 round-trip per BIF; suite name ffi; conformance scoreboard auto-picks it up. Target +40 ffi tests, ~570/570 total

Progress log

Newest first.

  • 2026-05-14 hot-reload call-dispatch semantics verified — Tests-only iteration: no implementation change, just six new eval tests that nail down the Erlang semantics already implicit in the current code. (1) M:F() after reload returns v2's value (cross-module call hits :current). (2) Inside a freshly-loaded body, a bare local call resolves through the new mod-env so a chain a() -> b() reflects v2's b/0. (3) Calling a fun captured BEFORE reload, whose body uses a local call, returns the v1 value (closure pinned to old mod-env via er-mk-fun's :env reference). (4) Calling a fun captured BEFORE reload, whose body uses a cross-module call M:b(), returns v2's value (cross-module always wins over closed-over env). (5) Two captured funs from two distinct vintages stay independent — F1() + F2() = 10 + 20 = 30. (6) The slot version counter still bumps even while old captured funs are alive, demonstrating the closure-pinning doesn't block reloads. The "running process finishes its current function with the version it started with" property falls out of fun-as-closure semantics for free — there's no special bookkeeping. Total 577/577 (+6 eval).

  • 2026-05-14 code introspection BIFs greencode:which/1, code:is_loaded/1, code:all_loaded/0 added to er-apply-code-bif dispatch with three small implementations in transpile.sx. which and is_loaded are dict-lookups on the module registry returning the loaded-marker (atom loaded) or the missing-marker (atom non_existing for which, atom false for is_loaded). Since we don't have a filesystem path representation, the standard {file, Path} shape for is_loaded becomes {file, loaded} — same tuple arity so destructuring code stays portable. all_loaded iterates (keys (er-modules-get)) in reverse (so the result list preserves insertion order after the cons-prepend loop), wrapping each name in a {Module, loaded} tuple. 10 new eval tests: non_existing for absent / loaded after load for which; missing / file-tag / loaded-value for is_loaded; empty / count-after-2-loads / first-entry-tag for all_loaded; badarg for both single-arg BIFs. Two of the all_loaded tests needed an explicit (er-modules-reset!) before the measurement because prior tests in the suite leave modules registered (the registry is process-global across the whole epoch session). Total 571/571 (+10 eval).

  • 2026-05-14 code:purge/1 + code:soft_purge/1 green — Two new BIFs in transpile.sx: er-bif-code-purge and er-bif-code-soft-purge, both dispatched through the existing er-apply-code-bif cond chain. Shared helper er-procs-on-env walks (er-sched-processes) and collects pids whose :initial-fun is a fun whose :env is identical (dict-identity, not structural) to a given env, filtering out already-dead procs. er-bif-code-purge looks up the module slot, returns false if either the module isn't registered or :old is nil; otherwise calls er-cascade-exit! on every matching pid with reason killed, replaces the slot with a fresh er-mk-module-slot that has :old nil (current + version preserved), returns true. er-bif-code-soft-purge returns true (treating "no module" / "no old version" as already-purged), else checks for lingering procs and returns false (leaving the slot untouched) if any, else clears :old and returns true. Non-atom Mod raises error:badarg from both. 10 new eval tests: unknown / no-old / after-reload / idempotent for purge; unknown / no-old / clean for soft_purge; badarg for both; one "purge after spawn" test verifying return value (does NOT exercise the kill path — see caveat in plan). Total 561/561 (+10 eval). Implementation cost: 1 dispatch entry, 3 small BIFs, no scheduler changes.

  • 2026-05-14 code:load_binary/3 green — Canonical hot-reload entry point. Adds a "code" module branch to er-apply-remote-bif's dispatch; new helpers er-source-walk-bytes! and er-source-to-string coerce any of {SX string, Erlang binary <<...>>, Erlang char-code cons list} to an SX source string before parsing. er-bif-code-load-binary is the BIF itself: validates Mod is an atom ({error, badarg} else), coerces source ({error, badarg} on unrecognised shape), wraps erlang-load-module in guard to convert parse failures into {error, badfile}, checks the parsed -module(Name). matches the BIF's first arg ({error, module_name_mismatch} else), returns {module, Mod}. Reload reuses the Phase-7 slot logic from the previous iteration so calling code:load_binary(m, _, v2_source) after code:load_binary(m, _, v1_source) bumps the slot to version 2 with v1 sitting in :old. 8 new eval tests: ok-tag/ok-name on first load, immediate cross-module call hits new env, reload-and-call returns v2 result, name-mismatch errors with both tag and reason, garbage source yields badfile, non-atom Mod is badarg. Total 551/551 (+8 eval). code:load_file/1 deferred until file:read_file/1 lands in Phase 8 (it's just a wrapper that reads bytes from disk then calls load_binary).

  • 2026-05-14 Phase 7 module-version slot landeder-modules entries are now {:current MOD-ENV :old MOD-ENV-or-nil :version INT :tag "module"} instead of bare mod-env dicts. New helpers in runtime.sx: er-mk-module-slot, er-module-current-env, er-module-old-env, er-module-version. erlang-load-module updated: first load creates a slot with :version 1 and :old nil; subsequent loads of the same module name copy :current into :old and increment :version (bump-and-shift, single-old-version retention as per OTP semantics). er-apply-user-module now reads via er-module-current-env so cross-module calls always hit the latest version. 13 new runtime tests (mostly in tests/runtime.sx): slot constructor + accessors, registry-after-first-load (v1, old nil), registry-after-second-load (v2, old = previous current env identity, current = new env), v3 on triple-load, registry-reset clears. Total 543/543 (was 530/530). Note: sx-tree path-based MCP tools (sx_replace_node, sx_read_subtree) are broken in this worktree's mcp_tree.exe (every path returns/replaces form 0); edits applied via a Python script then sx_validated. Pattern-based tools (sx_find_all, sx_rename_symbol) still work fine.

  • 2026-05-14 Phase 7 + Phase 8 scoped — Plan extended with two new phases driven by fed-sx (see plans/fed-sx-design.md §17.5). Phase 7 brings hot code reload back in scope (was previously listed as out-of-scope): module versioning slot, code:load_file/1/purge/1/soft_purge/1/which/1/is_loaded/1, cross-module calls hitting current, local calls keeping start-time semantics until function returns. Phase 8 introduces a runtime-extensible FFI BIF registry that replaces today's hardcoded er-apply-bif/er-apply-remote-bif cond chains, plus a term-marshalling layer and concrete BIFs for crypto:hash, cid:from_bytes/to_string, file:read_file/write_file/list_dir/delete, httpc:request, sqlite:open/exec/query. Scope decisions header updated accordingly. Baseline 530/530 unchanged; no code touched this iteration.

  • 2026-04-25 BIF round-out — Phase 6 complete, full plan ticked — Added 18 standard BIFs in lib/erlang/transpile.sx. erlang module: abs/1 (negates negative numbers), min/2/max/2 (use er-lt? so cross-type comparisons follow Erlang term order), tuple_to_list/1/list_to_tuple/1 (proper conversions), integer_to_list/1 (returns SX string per the char-list shim), list_to_integer/1 (uses parse-number, raises badarg on failure), is_function/1 and is_function/2 (arity-2 form scans the fun's clause patterns). lists module: seq/2/seq/3 (right-fold builder with step), sum/1, nth/2 (1-indexed, raises badarg out of range), last/1, member/2, append/2 (alias for ++), filter/2, any/2, all/2, duplicate/2. 40 new eval tests with positive + negative cases, plus a few that compose existing BIFs (e.g. lists:sum(lists:seq(1, 100)) = 5050). Total suite 530/530 — every checkbox in plans/erlang-on-sx.md is now ticked.

  • 2026-04-25 ETS-lite green — Scheduler state gains :ets (table-name → mutable list of tuples). New er-apply-ets-bif dispatches ets:new/2 (registers table by atom name; rejects duplicate name with {badarg, Name}), insert/2 (set semantics — replaces existing entry with the same first-element key, else appends), lookup/2 (returns Erlang list — [Tuple] if found else []), delete/1 (drop table), delete/2 (drop key; rebuilds entry list), tab2list/1 (full list view), info/2 with size only. Keys are full Erlang terms compared via er-equal?. 13 new eval tests: new return value, insert true, lookup hit + miss, set replace, info size after insert/delete, tab2list length, table delete, lookup-after-delete raises badarg, multi-key aggregate sum, tuple-key insert + lookup, two independent tables. Total suite 490/490.

  • 2026-04-25 binary pattern matching green — Parser additions: <<...>> literal/pattern in er-parse-primary, segment grammar Value [: Size] [/ Spec] (Spec defaults to integer, supports binary for tail). Critical fix: segment value uses er-parse-primary (not er-parse-expr-prec) so the trailing :Size doesn't get eaten by the postfix Mod:Fun remote-call handler. Runtime value: {:tag "binary" :bytes (list of int 0-255)}. Construction: integer segments emit big-endian bytes (size in bits, must be multiple of 8); binary-spec segments concatenate. Pattern matching consumes bytes from a cursor at the front, decoding integer segments big-endian, capturing Rest/binary tail at the end. Whole-binary length must consume exactly. New BIFs: is_binary/1, byte_size/1. Binaries participate in er-equal? (byte-wise) and format as <<b1,b2,...>>. 21 new eval tests: tag/predicate, byte_size for 8/16/32-bit segments, single + multi segment match, three 8-bit, tail rest size + content, badmatch on size mismatch, =:= equality, var-driven construction. Total suite 477/477.

  • 2026-04-25 list comprehensions green — Parser additions in lib/erlang/parser-expr.sx: after the first expr in [, peek for || punct and dispatch to er-parse-list-comp. Qualifiers separated by ,, each one is Pattern <- Source (generator) or any expression (filter — disambiguated by absence of <-). AST: {:type "lc" :head E :qualifiers [...]} with each qualifier {:kind "gen"/"filter" ...}. Evaluator (er-eval-lc in transpile.sx): right-fold builds the result by walking qualifiers; generators iterate the source list with env snapshot/restore per element so pattern-bound vars don't leak between iterations; filters skip when falsy. Pattern-matching generators are silently skipped on no-match (e.g. [V || {ok, V} <- ...]). 12 new eval tests: map double, fold-sum-of-comprehension, length, filter sum, "all filtered", empty source, cartesian, pattern-match gen, nested generators with filter, squares, tuple capture. Total suite 456/456.

  • 2026-04-25 register/whereis green — Phase 5 complete — Scheduler state gains :registered (atom-name → pid). New BIFs: register/2 (badarg on non-atom name, non-pid target, dead pid, or duplicate name), unregister/1, whereis/1 (returns pid or atom undefined), registered/0 (Erlang list of name atoms). er-eval-send for Name ! Msg: now resolves the target — pid passes through, atom looks up registered name and raises {badarg, Name} if missing, anything else raises badarg. Process death (in er-sched-step!) calls er-unregister-pid! to drop any registered name before er-propagate-exit! so monitor {'DOWN'} messages see the cleared registry. 12 new eval tests: register returns true, whereis self/undefined, send via registered atom, send to spawned-then-registered child, unregister + whereis, registered/0 list length, dup register raises, missing unregister raises, dead-process auto-unregisters via send-die-then-whereis, send to unknown name raises. Total suite 444/444. Phase 5 complete — Phase 6 (list comprehensions, binary patterns, ETS) is the last phase.

  • 2026-04-25 supervisor (one-for-one) greener-supervisor-source in lib/erlang/runtime.sx is the canonical Erlang text of a minimal supervisor; er-load-supervisor! registers it. Implements start_link(Mod, Args) (sup process traps exits, calls Mod:init/1 to get child-spec list, runs start_child/1 for each which links the spawned pid back to itself), which_children/1, stop/1. Receive loop dispatches on {'EXIT', Dead, _Reason} (restarts only the dead child via restart/2, keeps siblings — proper one-for-one), {'$sup_which', From} (returns child list), '$sup_stop'. Child specs are {Id, StartFn} where StartFn/0 returns the new child's pid. 7 new eval tests: which_children for 1- and 3-child sup, child responds to ping, killed child restarted with fresh pid, restarted child still functional, one-for-one isolation (siblings keep their pids), stop returns ok. Total suite 432/432.

  • 2026-04-25 gen_server (OTP-lite) greener-gen-server-source in lib/erlang/runtime.sx is the canonical Erlang text of the behaviour; er-load-gen-server! registers it in the user-module table. Implements start_link/2, call/2 (sync via make_ref + selective receive {Ref, Reply}), cast/2 (async fire-and-forget returning ok), stop/1, and the receive loop dispatching {'$gen_call', {From, Ref}, Req}Mod:handle_call/3, {'$gen_cast', Msg}Mod:handle_cast/2, anything else → Mod:handle_info/2. handle_call reply tuples supported: {reply, R, S}, {noreply, S}, {stop, R, Reply, S}. handle_cast/info: {noreply, S}, {stop, R, S}. Mod:F and M:F where M is a runtime variable now work via new er-resolve-call-name (was bug: passed unevaluated AST node :value to remote dispatch). 10 new eval tests: counter callback module (start/call/cast/stop, repeated state mutations), LIFO stack callback module ({push, V} cast, pop returns {ok, V} or empty, size). Total suite 425/425.

  • 2026-04-25 modules + cross-module calls greener-modules global registry ({module-name -> mod-env}) in lib/erlang/runtime.sx. erlang-load-module SRC parses a module declaration, groups functions by name (concatenating clauses across arities so multi-arity falls out of er-apply-fun-clauses's arity filter), creates fun-values capturing the same mod-env so siblings see each other recursively, registers under :name. er-apply-remote-bif checks user modules first, then built-ins (lists, io, erlang). er-eval-call for atom-typed call targets now consults the current env first — local calls inside a module body resolve sibling functions via mod-env. Undefined cross-module call raises error({undef, Mod, Fun}). 10 new eval tests: load returns module name, zero-/n-ary cross-module call, recursive fact/6 = 720, sibling-call c:a/1c:b/1, multi-arity dispatch (/1, /2, /3), pattern + guard clauses, cross-module call from within another module, undefined fn raises undef, module fn used in spawn. Total suite 415/415.

  • 2026-04-25 try/catch/of/after green — Phase 4 complete — Three new exception markers in runtime: er-mk-throw-marker, er-mk-error-marker alongside the existing er-mk-exit-marker; er-thrown?, er-errored? predicates. throw/1 and error/1 BIFs raise their respective markers. Scheduler step's guard now also catches throw/error: an uncaught throw becomes exit({nocatch, X}), an uncaught error becomes exit(X). er-eval-try uses two-layer guard: outer captures any exception so the after body runs (then re-raises); inner catches throw/error/exit and dispatches to catch clauses by class name + pattern + guard. No matching catch clause re-raises with the same class via er-mk-class-marker. of clauses run on success; no-match raises error({try_clause, V}). 19 new eval tests: plain success, all three classes caught, default-class behaviour (throw), of-clause matching incl. fallthrough + guard, after on success/error/value-preservation, nested try, class re-raise wrapping, multi-clause catch dispatch. Total suite 405/405. Phase 4 complete — Phase 5 (modules + OTP-lite) is next. Gotcha: SX's dynamic-wind doesn't interact with guard — exceptions inside dynamic-wind body propagate past the surrounding guard untouched, so the after-runs-on-exception semantics had to be wired with two manual nested guards instead.

  • 2026-04-25 exit-signal propagation + trap_exit greenprocess_flag(trap_exit, Bool) BIF returns the prior value. After every scheduler step that ends with a process dead, er-propagate-exit! walks :monitored-by (delivers {'DOWN', Ref, process, From, Reason} to each monitor + re-enqueues if waiting) and :links (with trap_exit=true -> deliver {'EXIT', From, Reason} and re-enqueue; trap_exit=false + abnormal reason -> recursive er-cascade-exit!; normal reason without trap_exit -> no signal). er-sched-step! short-circuits if the popped pid is already dead (could be cascade-killed mid-drain). 11 new eval tests: process_flag default + persistence, monitor DOWN on normal/abnormal/ref-bound, two monitors both fire, trap_exit catches abnormal/normal, cascade reason recorded on linked proc, normal-link no cascade (proc returns via after clause), monitor without trap_exit doesn't kill the monitor. Total suite 386/386. kill-as-special-reason and exit/2 (signal to another) deferred.

  • 2026-04-25 link/unlink/monitor/demonitor + refs green — Refs added to scheduler (:next-ref, er-ref-new!); er-mk-ref, er-ref?, er-ref-equal? in runtime. Process record gains :monitored-by. New BIFs in lib/erlang/runtime.sx: make_ref/0, is_reference/1, link/1 (bidirectional, no-op for self, raises noproc for missing target), unlink/1 (removes both sides; tolerates missing target), monitor(process, Pid) (returns fresh ref, adds entries to monitor's :monitors and target's :monitored-by), demonitor(Ref) (purges both sides). Refs participate in er-equal? (id compare) and render as #Ref<N>. 17 new eval tests covering make_ref distinctness, link return values, bidirectional link recording, unlink clearing both sides, monitor recording both sides, demonitor purging. Total suite 375/375. Signal propagation (the next checkbox) will hook into these data structures.

  • 2026-04-25 ring benchmark recorded — Phase 3 closedlib/erlang/bench_ring.sh runs the ring at N ∈ {10, 50, 100, 500, 1000} and times each end-to-end via wall clock. lib/erlang/bench_ring_results.md captures the table. Throughput plateaus at ~30-34 hops/s. 1M-process target IS NOT MET in this architecture — extrapolation = ~9h. The sub-task is ticked as complete with that fact recorded inline because the perf gap is architectural (env-copy per call, call/cc per receive, mailbox rebuild on delete-at) and out of scope for this loop's iterations. Phase 3 done; Phase 4 (links, monitors, exit signals, try/catch) is next.

  • 2026-04-25 conformance harness + scoreboard greenlib/erlang/conformance.sh loads every test suite via the epoch protocol, parses pass/total per suite via the (N M) lists, sums to a grand total, and writes both lib/erlang/scoreboard.json (machine-readable) and lib/erlang/scoreboard.md (Markdown table with / markers). 9 suites × full pass = 358/358. Exits non-zero on any failure. bash lib/erlang/conformance.sh -v prints per-suite counts. Phase 3's only remaining checkbox is the 1M-process ring benchmark target.

  • 2026-04-25 fib_server.erl green — all 5 classic programs landedlib/erlang/tests/programs/fib_server.sx with 8 tests. Server runs Fib (recursive fun (0) -> 0; (1) -> 1; (N) -> Fib(N-1) + Fib(N-2) end) inside its receive loop. Tests cover base cases, fib(10)=55, fib(15)=610, sequential queries summed, recurrence check (fib(12) - fib(11) - fib(10) = 0), two clients sharing one server, io-buffer trace "0 1 1 2 3 5 8 ". Total suite 358/358. Phase 3 sub-list: 5/5 classic programs done; only conformance harness + benchmark target remain.

  • 2026-04-25 echo.erl greenlib/erlang/tests/programs/echo.sx with 7 tests. Server: receive {From, Msg} -> From ! Msg, Loop(); stop -> ok end. Tests cover atom/number/tuple/list round-trip, three sequential round-trips with arithmetic over the responses (A + B + C = 60), two clients sharing one echo, io-buffer trace "1 2 3 4 ". Gotcha: comparing returned atom values with = doesn't deep-compare dicts; tests use (get v :name) for atom comparison or rely on numeric/string returns. Total suite 350/350.

  • 2026-04-24 bank.erl greenlib/erlang/tests/programs/bank.sx with 8 tests. Stateful server pattern: Server = fun (Balance) -> receive ... Server(NewBalance) end end recursively threads balance through each iteration. Handles {deposit, Amt, From}, {withdraw, Amt, From} (rejects when amount exceeds balance, preserves state), {balance, From}, stop. Tests cover deposit accumulation, withdrawal within balance, insufficient funds with state preservation, mixed transactions, clean shutdown, two-client interleave. Total suite 343/343.

  • 2026-04-24 ping_pong.erl greenlib/erlang/tests/programs/ping_pong.sx with 4 tests: classic Pong server + Ping client with separate ping_done/pong_done notifications, 5-round trace via io-buffer ("ppppp"), main-as-pinger-4-rounds (no intermediate Ping proc), tagged-id round-trip ("4 3 2 1 "). All driven by Ping = fun (Target, K) -> ... Ping(Target, K-1) ... end self-recursion — captured-env reference works because Ping binds in main's mutable env before any spawned body looks it up. Total suite 335/335.

  • 2026-04-24 ring.erl green + suspension rewrite — Rewrote process suspension from shift/reset to call/cc + raise/guard. Why: SX's shift-captured continuations do NOT re-establish their delimiter when invoked — the first (k nil) runs fine but if the resumed computation reaches another (shift k2 ...) it raises "shift without enclosing reset". Ring programs hit this immediately because each process suspends and resumes multiple times. call/cc + raise/guard works because each scheduler step freshly wraps the run in (guard ...), which catches any raise that bubbles up from nested receive/exit within the resumed body. Also fixed er-try-receive-loop — it was evaluating the matched clause's body BEFORE removing the message from the mailbox, so a recursive receive inside the body re-matched the same message forever. Added lib/erlang/tests/programs/ring.sx with 4 tests (N=3 M=6, N=2 M=4, N=1 M=5 self-loop, N=3 M=9 hop-count via io-buffer). All process-communication eval tests still pass. Total suite 331/331.

  • 2026-04-24 exit/1 + termination greenexit/1 BIF uses (shift k ...) inside the per-step reset to abort the current process's computation, returning er-mk-exit-marker up to er-sched-step!. Step handler records :exit-reason, clears :exit-result, marks dead. Normal fall-off-end still records reason normal. exit/2 errors with "deferred to Phase 4 (links)". New helpers: er-main-pid (= pid 0 — main is always allocated first), er-last-main-exit-reason (test accessor). 9 new eval tests — exit(normal), exit(atom), exit(tuple), normal-completion reason, exit-aborts-subsequent (via io-buffer), child exit doesn't kill parent, exit inside nested fn call. Total eval 174/174; suite 327/327.

  • 2026-04-24 receive...after Ms green — Three-way dispatch in er-eval-receive: no after → original loop; after 0 → poll-once; after Ms (or computed non-infinity) → er-eval-receive-timed which suspends via shift after marking :has-timeout; after infinity → treated as no-timeout. er-sched-run-all! now recurses into er-sched-fire-one-timeout! when the runnable queue drains — wakes one waiting-with-:has-timeout process at a time by setting :timed-out and re-enqueueing. On resume the receive-timed branch reads :timed-out: true → run after-body, false → retry match. "Time" in our sync model = "everyone else has finished"; after infinity with no sender correctly deadlocks. 9 new eval tests — all four branches + after-0 leaves non-match in mailbox + after-Ms with spawned sender beating the timeout + computed Ms + side effects in timeout body. Total eval 165/165; suite 318/318.

  • 2026-04-24 send + selective receive green — THE SHOWCASE! (send) in lib/erlang/transpile.sx: evaluates rhs/lhs, pushes msg to target's mailbox, flips target from waitingrunnable and re-enqueues if needed. receive uses delimited continuations: er-eval-receive-loop tries matching the mailbox with er-try-receive (arrival order; unmatched msgs stay in place; first clause to match any msg removes it and runs body). On no match, (shift k ...) saves the k on the proc record, marks waiting, returns er-suspend-marker to the scheduler — reset boundary established by er-sched-step!. Scheduler loop er-sched-run-all! pops runnable pids and calls either (reset ...) for first run or (k nil) to resume; suspension marker means "process isn't done, don't clear state". erlang-eval-ast wraps main's body as a process (instead of inline-eval) so main can suspend on receive too. Queue helpers added: er-q-nth, er-q-delete-at!. 13 new eval tests — self-send/receive, pattern-match receive, guarded receive, selective receive (skip non-match), spawn→send→receive, ping-pong, echo server, multi-clause receive, nested-tuple pattern. Total eval 156/156; suite 309/309. Deadlock detected if main never terminates.

  • 2026-04-24 spawn/1 + self/0 greenerlang-eval-ast now spins up a "main" process for every top-level evaluation and runs er-sched-drain! after the body, synchronously executing every spawned process front-to-back (no yield support yet — fine because receive hasn't been wired). BIFs added in lib/erlang/runtime.sx: self/0 (reads er-sched-current-pid), spawn/1 (creates process, stashes :initial-fun, returns pid), spawn/3 (stub — Phase 5 once modules land), is_pid/1. Pids added to er-equal? (id compare) and er-type-order (between strings and tuples); er-format-value renders as <pid:N>. 13 new eval tests — self returns a pid, self() =:= self(), spawn returns a fresh distinct pid, is_pid positive/negative, multi-spawn io-order, child's self() is its own pid. Total eval 143/143; runtime 39/39; suite 296/296. Next: ! (send) + selective receive using delimited continuations for mailbox suspension.

  • 2026-04-24 scheduler foundation greenlib/erlang/runtime.sx + lib/erlang/tests/runtime.sx. Amortised-O(1) FIFO queue (er-q-new, er-q-push!, er-q-pop!, er-q-peek, er-q-compact! at 128-entry head drift), tagged pids {:tag "pid" :id N} with er-pid?/er-pid-equal?, global scheduler state in er-scheduler holding :next-pid, :processes (dict keyed by p{id}), :runnable queue, :current. Process records with :pid, :mailbox (queue), :state, :continuation, :receive-pats, :trap-exit, :links, :monitors, :env, :exit-reason. 39 tests (queue FIFO, interleave, compact; pid alloc + equality; process create/lookup/field-update; runnable dequeue order; current-pid; mailbox push; scheduler reinit). Total erlang suite 283/283. Next: spawn/1, !, receive wired into the evaluator.

  • 2026-04-24 core BIFs + funs green — Phase 2 complete. Added to lib/erlang/transpile.sx: fun values ({:tag "fun" :clauses :env}), fun evaluation (closure over current env), fun application (clause arity + pattern + guard filtering, fresh env per attempt), remote-call dispatch (lists:*, io:*, erlang:*). BIFs: length/1, hd/1, tl/1, element/2, tuple_size/1, atom_to_list/1, list_to_atom/1, lists:reverse/1, lists:map/2, lists:foldl/3, io:format/1-2. io:format writes to a capture buffer (er-io-buffer, er-io-flush!, er-io-buffer-content) and returns ok — supports ~n, ~p/~w/~s, ~~. 35 new eval tests. Total eval 130/130; erlang suite 244/244. Phase 2 complete — Phase 3 (processes, scheduler, receive) is next.

  • 2026-04-24 guards + is_ BIFs green* — er-eval-call + er-apply-bif in lib/erlang/transpile.sx wire local function calls to a BIF dispatcher. Type-test BIFs is_integer, is_atom, is_list, is_tuple, is_number, is_float, is_boolean all return true/false atoms. Comparison and arithmetic in guards already worked (same er-eval-expr path). 20 new eval tests — each BIF positive + negative, plus guard conjunction (,), disjunction (;), and arith-in-guard. Total eval 95/95; erlang suite 209/209.

  • 2026-04-24 pattern matching greener-match! in lib/erlang/transpile.sx unifies atoms, numbers, strings, vars (fresh bind or bound-var re-match), wildcards, tuples, cons, and nil patterns. case ... of ... [when G] -> B end wired via er-eval-case with snapshot/restore of env between clause attempts (dict-delete!-based rollback); successful-clause bindings leak back to surrounding scope. 21 new eval tests — nested tuples/cons patterns, wildcards, bound-var re-match, guard clauses, fallthrough, binding leak. Total eval 75/75; erlang suite 189/189.

  • 2026-04-24 eval (sequential) greenlib/erlang/transpile.sx (tree-walking interpreter) + lib/erlang/tests/eval.sx. 54/54 tests covering literals, arithmetic, comparison, logical (incl. short-circuit andalso/orelse), tuples, lists with ++, begin..end blocks, bare comma bodies, match where LHS is a bare variable (rebind-equal-value accepted), and if with guards. Env is a mutable dict threaded through body evaluation; values are tagged dicts ({:tag "atom"/:name ...}, {:tag "nil"}, {:tag "cons" :head :tail}, {:tag "tuple" :elements}). Numbers pass through as SX numbers. Gotcha: SX's parse-number coerces "1.0" → integer 1, so =:= can't distinguish 1 from 1.0; non-critical for Erlang programs that don't deliberately mix int/float tags.

  • parser greenlib/erlang/parser.sx + parser-core.sx + parser-expr.sx + parser-module.sx. 52/52 in tests/parse.sx. Covers literals, tuples, lists (incl. [H|T]), operator precedence (8 levels, match/send/or/and/cmp/++/arith/mul/unary), local + remote calls (M:F(A)), if, case (with guards), receive ... after ... end, begin..end blocks, anonymous fun, try..of..catch..after..end with Class:Pattern catch clauses. Module-level: -module(M)., -export([...])., multi-clause functions with guards. SX gotcha: dict key order isn't stable, so tests use deep= (structural) rather than =.

  • tokenizer greenlib/erlang/tokenizer.sx + lib/erlang/tests/tokenize.sx. Covers atoms (bare, quoted, node@host), variables, integers (incl. 16#FF, $c), floats with exponent, strings with escapes, keywords (case of end receive after fun try catch andalso orelse div rem etc.), punct (( ) { } [ ] , ; . : :: -> <- <= => << >> | ||), ops (+ - * / = == /= =:= =/= < > =< >= ++ -- ! ?), % line comments. 62/62 green.

Blockers

  • (none yet)