Switch SSR + shell from native Sx_render to SX adapter (render-to-html
from adapter-html.sx) via CEK evaluator. Handles reactive primitives
(signals, deref, computed) for island bodies. Native renderer as fallback.
Header island SSRs correctly: (<sx>), tagline, copyright, path.
Stepper renders body but ~cssx/tw shows as raw SX (client-affinity
component not expanded server-side, client not expanding either).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Island SSR reverted to placeholder approach (full SSR crashed on
reactive code). Placeholders include SX call expression for client
hydration. CSS hides placeholder text until WASM renders.
Remaining: need SX adapter (adapter-html.sx) for island SSR instead
of native Sx_render — the SX adapter handles signals/deref/computed
via the CEK machine. Native renderer doesn't support reactive primitives.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Include cssx.sx source in component-defs for client CSSX runtime.
Island placeholders now contain SX call expression for client hydration.
escape_sx_string only escapes </script, not all </ sequences.
serialize_value: no (list) wrapper, matching Python serialize() exactly.
Homepage: header renders (<sx>, tagline, copyright), stepper shows
raw SX (cssx/tw not expanding client-side). Geography fully rendered
including island hydration.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
serialize_value: all lists emit (items...) not (list items...), matching
Python serialize() exactly. Empty lists emit (). This fixes let bindings,
fn params, and data structures for client-side parsing.
Component-defs now include named lambdas, macros, dicts, and other named
values from the env — client needs CSSX functions (cssx-process-token,
cssx-colour-props, cssx-spacing-props etc.) for island hydration.
Fixes: cssx-process-token, cssx-colour-props undefined errors.
Geography page: fully rendered with header island hydration working.
Homepage: nav renders, no error banners, stepper silent.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
serialize_value: lists with symbol head emit (fn args...) not (list fn args).
This lets the client SX parser recognise special forms like let, when, cond
inside component-defs. Data lists (starting with non-symbols) keep the
(list ...) wrapper.
Fixes "Undefined symbol: let" WASM error that broke all island hydration.
Header island now reaches the JIT evaluator (fails on for-each VM error,
not parsing). Geography, SXTP, CEK pages fully rendered.
Removed debug logging (ssr-debug, debug dump, debug endpoint).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Homepage fix: path_expr "home" was evaluated as a symbol lookup (returning
the Lambda) instead of a function call. Now wraps bare symbols in a list:
home → (home) → calls the page function → returns component call.
Slug routing: auto_quote converts unknown symbols to strings before eval.
(etc (plan sx-host)) → (etc (plan "sx-host")) — resolves nested slug URLs.
Resilient SSR: render_to_buf catches Eval_error per-element and continues
rendering. Partial SSR output preserved even when some elements fail.
WASM kernel rebuilt (define shorthand + island placeholder changes).
Remaining: WASM kernel "Undefined symbol: let" — pre-existing bug in
client-side component-defs parsing. (list let ...) triggers symbol lookup
instead of special form recognition. Affects island hydration on all pages.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
escape_sx_string now escapes </ as <\\/ inside SX string literals,
matching Python's serialize() behavior. This prevents the HTML parser
from matching </script> inside component-defs strings while keeping
the SX valid for the client parser.
Component-defs back to inline <script data-components> (reverts
external endpoint approach). init-sx triggers client render when
sx-root is empty.
Geography page: fully rendered with header, nav, content, styling.
Header island hydration warning (Undefined symbol: let) is a
pre-existing WASM kernel issue, not related to the HTTP server.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Islands now always emit <span data-sx-island="name"> placeholder
instead of attempting SSR. Island bodies contain client-only symbols
(signals, DOM refs) that cascade errors during native render.
Component-defs moved to /static/sx-components.sx endpoint instead of
inline <script> — avoids </script> escaping issues that broke the
client-side SX parser.
Remaining: client WASM kernel not loading components from external
endpoint (expects inline script tag). Need to configure client boot
to fetch from /static/sx-components.sx.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Escape </script sequences in component-defs (replace </ with <\/ before s/S)
- Build pages-sx registry from defpage definitions (51 routes for client router)
- SSR fallback: emit minimal layout HTML when full SSR fails
- Redirect / → /sx/
- Load sxc/ components for ~docs/page
- Block .wasm.assets/ build artifacts but allow .wasm runtime files
Geography page renders correctly with full styling and content.
Homepage still blank — client boot doesn't render from page-sx on
initial load (only on navigation). Needs homepage SSR to succeed,
which requires fixing the stepper island's <home symbol.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
OCaml HTTP server now serves /static/* files with MIME types, immutable
cache headers, and in-memory caching. Computes MD5 hashes for JS/WASM
files and injects them as ?v= cache-busting query params.
Inline CSS: reads tw.css + basics.css at startup, injects into
<style id="sx-css"> tag. Pages now render with full Tailwind styling.
Shell statics now include real file hashes:
sx-js-hash, body-js-hash, wasm-hash — 12-char MD5 hex
Docker compose: mounts shared/static as /app/static for the container.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Load sx/sxc/ directory for core layout components like ~docs/page,
~docs/section, ~docs/code. Auto-detect Docker (/app/sxc) vs dev
(/project/sx/sxc) paths with SX_SXC_DIR env override.
Fixes pages that use ~docs/page — all content pages now render
correctly with full component expansion.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
docker-compose.dev-sx-native.yml overrides entrypoint to run OCaml
HTTP server inside Docker container (Caddy on externalnet can reach it).
Auto-detect sx component directory: checks /app/sx (Docker) first,
falls back to /project/sx/sx (dev). SX_COMPONENTS_DIR env override.
Live on sx.rose-ash.com via Caddy → Docker → OCaml HTTP server.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Single command to start the native OCaml HTTP server for sx-docs.
No Docker, no Python, no Quart — just the OCaml binary + Caddy.
./dev-sx-native.sh # port 8013
./dev-sx-native.sh 8014 # custom port
./dev-sx-native.sh --build # rebuild first
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Render 5 key pages during startup to trigger JIT compilation of page
functions, aser, render-to-html, and all component paths. Steady-state
performance after warmup:
Homepage: 212-280ms (aser=136-173ms, ssr=44-90ms)
Geography: 282-354ms (aser=215-273ms, ssr=44-61ms)
Reactive: 356-522ms (aser=306-390ms, ssr=38-109ms)
SSR phase is fast (streaming renderer). Aser is the bottleneck —
response caching eliminates it for static pages.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
New render_to_buf / render_to_html_streaming in sx_render.ml — writes
HTML directly to a Buffer.t instead of building intermediate strings.
Eliminates hundreds of string concatenations per page render.
Full parallel renderer: render_to_buf, render_element_buf,
render_component_buf, render_cond_buf, render_let_buf, render_map_buf,
render_for_each_buf — all buffer-native.
HTTP server SSR + shell now use streaming renderer.
Performance (warm, 2 worker domains, 2MB RSS):
Homepage: 138-195ms TTFB (Quart: 202ms) — faster
Geography: 218-286ms TTFB (Quart: 144ms)
Throughput: 6.85 req/s at c=5 (Quart: 6.8 req/s) — matched
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
JIT runtime errors now log once per function name via _jit_warned
hashtable, then stay quiet for that function. No more silent swallowing
(which hid real errors) or per-call flooding (which spammed thousands
of lines and blocked the server).
VM-level fallbacks (inside JIT-compiled code calling other JIT code)
are silent — dedup happens at the hook level.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Domain pool with N workers (Domain.recommended_domain_count), mutex+
condition queue for request dispatch. Each domain has its own minor
heap — GC pauses don't block other requests.
expand-components? bound once at startup (always true in HTTP mode)
instead of per-request mutation. Shell rendering uses native
Sx_render.render_to_html for domain safety.
Performance (warm, 2 worker domains, 2MB RSS):
Homepage: 107-194ms TTFB (Quart: 202ms) — faster
Geography: 199-306ms TTFB (Quart: 144ms) — close
Reactive: 351-382ms TTFB (Quart: 187ms) — 2x slower
Concurrent: 5.88 req/s at c=5 (Quart: 6.8 req/s)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Switch SSR from SX adapter to native Sx_render.render_to_html.
Islands that fail SSR emit <span data-sx-island="name"> placeholders
instead of recursing into client-only bodies. Eliminates the <home
symbol error cascade that made the homepage render 23s.
Performance (warm, single process):
Homepage: 131-191ms TTFB (was 202ms on Quart) — faster
Geography: 203-229ms TTFB (was 144ms on Quart) — close
Reactive: 155-290ms TTFB (was 187ms on Quart) — similar
Memory: 2MB RSS (was 570MB on Quart) — 285x reduction
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
JIT runtime errors now silently fall back to CEK without disabling the
compiled bytecode or logging. This prevents render-to-html from being
permanently disabled when one page has an unresolved symbol (e.g. the
homepage stepper's <home).
Load spec/signals.sx and web/engine.sx for reactive primitives.
Skip test files and non-rendering directories (tests/, plans/, essays/).
Performance with JIT active (warm, single process, 2MB RSS):
- Aser (component expansion): 21-87ms — faster than Quart baseline
- SSR + shell: variable due to homepage <home fallback issue
- Geography total: ~500ms when JIT stays active
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Enable lazy JIT in HTTP mode — pre-compile 24 compiler functions at startup
- Load spec/signals.sx + web/engine.sx for reactive primitives
- Recursive directory loading for subdirectory components (geography/, etc.)
- Re-bind native variadic assoc after stdlib.sx overwrites it
- Skip test files, plans/, essays/ directories during HTTP load
- Homepage aser: 21-38ms warm, Geography aser: 39-87ms warm
Remaining: render-to-html JIT gets disabled by <home symbol error on
first request (falls back to CEK). ~docs/page component missing for
some pages. Fix those for full parity with Quart.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Reverse hook syncs VM GLOBAL_SET mutations back to global_env so CEK reads
see JIT-written values. Isomorphic nav: store primitives, event-bridge,
client? predicate. Browser JS and bytecode rebuilt.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Full protocol specification covering requests, responses, verbs,
headers, cookies, status conditions, addressing, streaming,
capabilities, caching, and wire format. Everything is s-expressions.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- def-store/use-store/clear-stores: OCaml primitives with global
mutable registry. Bypasses env scoping issues that prevented SX-level
stores from persisting across bytecode module boundaries.
- client? primitive: _is_client ref (false on server, true in browser).
Registered in primitives table for CALL_PRIM compatibility.
- Event-bridge island: rewritten to use document-level addEventListener
via effect + host-callback, fixing container-ref timing issue.
- Header island: uses def-store for idx/shade signals when client? is
true, plain signals when false (SSR compatibility).
- web-signals.sx: SX store definitions removed, OCaml primitives replace.
Isomorphic nav still fixme — client? works from K.eval but the JIT
"Not callable: nil" bug prevents proper primitive resolution during
render-to-dom hydration. Needs JIT investigation.
100 passed, 1 skipped, 0 failed.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Event-bridge: rewrite island to use document-level addEventListener
via effect + host-callback, bypassing broken container-ref + schedule-idle.
Also use host-get for event-detail (WASM host handles).
- Add client? primitive: false on server (sx_primitives._is_client ref),
true in browser (sx_browser.ml sets ref). Enables SSR-safe conditional
logic for client-only features like def-store.
- Header island: use def-store for idx/shade signals when client? is true,
falling back to plain signals on server. Foundation for SPA nav state
preservation (store registry persistence still needs work).
- Remove unused client? K.eval override from sx-platform.js.
100 passed, 1 skipped (isomorphic nav — store registry resets on SPA nav), 0 failed.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- sx_browser.ml: use Sx_ref.trampoline instead of Sx_runtime.trampoline
(the stub was a no-op, causing cek-call to return unresolved Thunks).
Fixes resource island promise resolution — promises now resolve and
update signals correctly.
- event-bridge island: use host-get instead of get for event-detail,
since WASM kernel returns JS host handles for CustomEvent detail
objects, not native SX dicts.
- Mark event-bridge and isomorphic-nav as test.fixme (deeper issues
remain: event handler swap! doesn't propagate to DOM; header island
inside #main-panel swap boundary needs structural layout change).
99 passed, 2 skipped, 0 failed.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The OCaml `apply` primitive only handled NativeFn, causing swap! to
fail in the WASM browser when called with lambda arguments. Extended
to handle all callable types via _sx_call_fn/_sx_trampoline_fn.
Also fixes:
- Pre-existing build errors from int-interned env.bindings migration
(vm-trace, bytecode-inspect, deps-check, prim-check in sx_server.ml)
- Add #portal-root div to page shell for portal island rendering
- Stepper test scoped to lake area (code-view legitimately shows ~cssx/tw)
- Portal test checks #portal-root instead of #sx-root
- Mark 3 known bugs as test.fixme (event-bridge, resource, isomorphic-nav)
98 passed, 3 skipped, 0 failed.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Removed duplicate one-liner sx-nav-tree (leftover from before refactor)
- Renamed "Semantics" → "Capabilities" in nav tree — direct geography
entry, no subsection
- Added "Where code evaluates" section with three demos:
- Server-side fetch (SSR with io capability)
- Client-side fetch (island with reactive signals)
- Same component both ways (isomorphic evaluation)
- Shows how capabilities abstract over location — same code runs
server or client depending on the evaluation context
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The tool only scanned nav-data.sx with raw AST walking, missing entries
that use (dict :key val) call syntax instead of {:key val} literals.
Now scans both nav-data.sx and nav-tree.sx, evaluating expressions
through the SX evaluator so dict calls produce proper Dict values.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The nav tree was a 4KB single-line dict literal that was impossible to
read, edit, or diff. Converted to explicit (dict :key val ...) calls
with proper indentation. Now 100+ lines, each nav entry on its own line.
Also added Native Browser to the applications section of the nav tree
(was missing — the entry existed in nav-data.sx but not in the tree
that the sidebar actually renders from).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Three modes:
- list: show all nav items, filterable by section
- check: validate consistency (duplicate hrefs, missing page functions,
components without nav entries)
- add: scaffold new article (component file + page function + nav entry)
Scans nav-data.sx, page-functions.sx, and all .sx component files.
Prevents the class of bugs where nav entries, page functions, and
component definitions get out of sync.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
New article at /sx/(applications.(native-browser)) describing the vision
for a native SX desktop browser that renders s-expressions directly to
pixels via Cairo + SDL2, bypassing HTML/CSS/JS entirely.
Covers: architecture, 15-primitive platform interface, the strange loop
(browser written in SX), adoption path alongside the web, and the POC
counter demo.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
spec/canonical.sx defines:
- canonical-serialize: deterministic s-expression serialization
(sorted dict keys, normalized numbers, minimal escaping)
- content-id: SHA3-256 of canonical form = CID of any s-expression
- Bytecode module format: (sxbc version source-hash (code ...))
- Provenance records linking source CID → bytecode CID → compiler CID
The CID is the identity model for SX. A component, a bytecode module,
a test suite — anything expressed as an s-expression — is addressable
by content hash. Annotation layers (source maps, variable names, test
results, documentation) reference CIDs without polluting the artifacts.
Requires host primitives: sha3-256, sort. Tests in test-canonical.sx.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Bytecode modules are now serialized as s-expressions (.sxbc) in addition
to JSON (.sxbc.json). The .sxbc format is the canonical representation —
content-addressable, parseable by the SX parser, and suitable for CID
referencing. Annotation layers (source maps, variable names, tests, docs)
can reference the bytecode CID without polluting the bytecode itself.
Format: (sxbc version hash (code :arity N :bytecode (...) :constants (...)))
The browser loader tries .sxbc first (via load-sxbc kernel primitive),
falls back to .sxbc.json. Caddy needs .sxbc MIME type to serve the new
format (currently 404s, JSON fallback works).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Two bugs fixed:
1. Links: bytecode compiler doesn't handle &rest params — treats them as
positional, so (first rest) gets a raw string instead of a list.
Replaced &rest with explicit optional params in all bytecode-compiled
web SX files (dom-query, dom-add-listener, browser-push-state, etc.).
The VM already pads missing args with Nil.
2. Reactive counter: signal-remove-sub! used (filter ...) which returns
immutable List, but signal-add-sub! uses (append!) which only mutates
ListRef. Subscribers silently vanished after first effect re-run.
Fixed by adding remove! primitive that mutates ListRef in-place.
Also:
- Added evalVM API to WASM kernel (compile + run through bytecode VM)
- Added scope tracing (scope-push!/pop!/peek/context instrumentation)
- Added Playwright reactive mode for debugging island signal/DOM state
- Replaced cek-call with direct calls in core-signals.sx effect/computed
- Recompiled all 23 bytecode modules
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Tools: vm-trace, bytecode-inspect, deps-check, prim-check,
test_boot.sh, sx-build-all.sh — with usage examples.
Island rules: (do ...) for multi-expression bodies, nested let for
cross-references, (deref (computed ...)) for reactive derived text,
effects in inner let for OCaml SSR compatibility.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
List.find returns the element that matched, but SX some should return
the callback's truthy return value. This caused get-verb-info to return
"get" (the verb string) instead of the {method, url} dict.
Also added _active_vm tracking to VM for future HO primitive optimization,
and reverted get-verb-info to use some (no longer needs for-each workaround).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The some HO form passes callbacks through call_sx_fn which creates a new
VM that can't see the enclosing closure's captured variables (el). Replaced
with for-each + mutation which keeps everything in the same VM scope.
Also fixed destructuring param ((verb ...)) → plain param (verb).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The sx-get links were doing full page refreshes because click handlers
never attached. Root causes: VM frame management bug, missing primitives,
CEK/VM type dispatch mismatch, and silent error swallowing.
Fixes:
- VM frame exhaustion: frames <- [] now properly pops to rest_frames
- length primitive: add alias for len in OCaml primitives
- call_sx_fn: use sx_call directly instead of eval_expr (CEK checks
for type "lambda" but VmClosure reports "function")
- Boot error surfacing: Sx.init() now has try/catch + failure summary
- Callback error surfacing: catch-all handler for non-Eval_error exceptions
- Silent JIT failures: log before CEK fallback instead of swallowing
- vm→env sync: loadModule now calls sync_vm_to_env()
- sx_build_bytecode MCP tool added for bytecode compilation
Tests: 50 new tests across test-vm.sx and test-vm-primitives.sx covering
nested VM calls, frame integrity, CEK bridge, primitive availability,
cross-module symbol resolution, and callback dispatch.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- compile-modules.js: Node.js build tool, all 23 .sx files compile to .sxbc.json
- api_load_module with shared globals (beginModuleLoad/endModuleLoad batch API)
- api_compile_module for runtime compilation
- sx-platform.js: bytecode-first loader with source fallback, JSON deserializer
- Deferred JIT enable (setTimeout after boot)
Known issues:
- WASM browser: loadModule loads but functions not accessible (env writeback
issue with interned keys)
- WASM browser: compileModule fails ("Not callable: nil" — compile-module
function from bytecode not working correctly in WASM context)
- Node.js js_of_ocaml: full roundtrip works (compile → load → call)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- sx_browser.ml: add api_load_module (execute pre-compiled bytecode on VM,
copy defines back to env) and api_compile_module (compile SX source to
bytecode via compile-module function)
- compile-modules.js: Node.js build tool that loads the js_of_ocaml kernel,
compiles all 23 .sx platform files to bytecode, writes .sxbc.json files
- Serialization format: type-tagged JSON constants (s/n/b/nil/sym/kw/list/code)
with nested code objects for lambda closures
All 23 files compile successfully (430K total bytecode JSON).
Next: wire up sx-platform.js to load bytecode instead of source.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
