# content-on-sx: Documents, blocks & collaborative editing on Smalltalk > **DRAFT outline.** The CMS vertical — blog, WYSIWYG editor, Ghost sync. Depends > on `persist-on-sx` (document history as an event log). Ghost/CMS sync stays a thin > external adapter (Python/FFI) until a native replacement exists. rose-ash's `blog` domain is content management: a block-based WYSIWYG editor, navigation, Ghost CMS sync. A document is a tree of live blocks; editing is a stream of operations; collaboration needs conflict-free merge. That is an object model — blocks are objects, edits are messages, and a document is the object graph responding to them. Smalltalk's "everything is an object responding to messages" maps directly to a block/WYSIWYG model, and a semilattice (CRDT) merge keeps concurrent edits conflict-free. End-state: a Smalltalk-on-SX document model (typed blocks, structural ops), operation log + CRDT merge for collaborative editing, versioning/history via the event store, and a render boundary to HTML/SX. External CMS (Ghost) sync is an injected adapter, not core. ## Status (rolling) `bash lib/content/conformance.sh` → **746/746** (Phases 1–4 COMPLETE + ~34 extensions, hardened: HTML/SX escaping, Markdown render + import/export incl. tables & frontmatter (full round-trip), CvRDT flat + nested-tree + durable replication, tree-aware validation, snapshot cache, doc metadata, plain-text render, nested block trees + deep editing + flatten + relative reorder, doc stats + summary + multi-doc index, table + callout + media blocks, HTML page wrapper + SEO page, doc composition + id-remap, portable data + wire serialization, block query + transforms + find/replace, TOC + anchored headings + outline, normalization) ## Ground rules - **Scope:** only `lib/content/**` and `plans/content-on-sx.md`. May **import** from `lib/smalltalk/`, and (once it exists) `lib/persist/`. Do not edit substrates. - **Architecture:** a document is an ordered tree of blocks (objects); an edit is a message (`insert`/`update`/`move`/`delete`); concurrent edits merge via a commutative (CRDT/semilattice) operation so order doesn't matter. History is the `persist` event stream; any version is a replay. - **Determinism:** merge must be commutative + idempotent (test: apply ops in any order / twice → same document). - **Commits:** one feature per commit. Progress log + tick boxes. ## Architecture sketch ``` Edit op Rendered document (insert block after id) ... HTML / SX tree │ ▲ ▼ │ lib/content/block.sx lib/content/render.sx — typed blocks as objects — block tree → HTML/SX — heading/text/image/embed — (reuses SX render boundary) │ ▲ ▼ │ lib/content/doc.sx lib/content/merge.sx — ordered block tree — CRDT/semilattice op merge — apply op, structural moves — concurrent-edit reconciliation │ ▲ ▼ │ lib/content/api.sx ── (content/edit) (content/render) (content/history) ──┐ │ │ ├── op log + versions → persist │ └── Ghost/CMS sync → injected external adapter (thin, non-core) ──┘ ``` ## Phase 1 — Block document model - [x] `block.sx` — typed block objects - [x] `doc.sx` — ordered tree, apply edit op, structural moves - [x] `render.sx` — block tree → HTML/SX - [x] `api.sx` + tests + scoreboard + conformance.sh ## Phase 2 — Op log + versioning - [x] edit ops as `persist` events; replay to any version - [x] `(content/history doc)`, diff between versions ## Phase 3 — Collaborative merge (CRDT) - [x] commutative/idempotent op merge - [x] concurrent-edit tests (any order, double-apply → identical) ## Phase 4 — External sync + federation - [x] Ghost/CMS sync via injected adapter (import/export) - [x] federated documents (peer-authored blocks) — trust-gated stub - [x] tests: round-trip import/export, conflict on concurrent external edit ## Extensions (post-roadmap) - [x] HTML escaping at the render boundary (`String>>htmlEscaped`: & < > ") - [x] asSx wire string-escaping (`String>>sxEscaped`: \ and " in SX literals) - [x] Markdown render mode (`asMarkdown:` / `content/render doc "md"`) - [x] durable CRDT replication (`crdt-store.sx`: ops on persist, replay + converge) - [x] document validation (`validate.sx`: ids, per-type fields, duplicate ids; tree-aware — descends into sections, tree-wide dup ids, section field check) - [x] Markdown import adapter (`md-import.sx`: text → blocks, round-trips export; incl. pipe tables + frontmatter → metadata) - [x] Markdown doc export (`md-doc.sx`: content/markdown-doc, frontmatter from metadata, full round-trip) - [x] snapshot cache over replay (`snapshot.sx`: cache-not-primary, transparent) - [x] document metadata (`meta.sx`: title/slug/tags + Ghost title plumbing) - [x] plain-text render + excerpt (`text.sx`: asText, content/excerpt) - [x] nested block trees (`section.sx`: CtSection container, recursive render, deep-find) - [x] document statistics (`stats.sx`: word/char/block counts, reading time) - [x] table block (`table.sx`: CtTable, renders html/sx/text/md, validated) - [x] callout block (`callout.sx`: CtCallout note/warning/tip, renders html/sx/text/md, validated) - [x] media block (`media.sx`: CtMedia video/audio, renders html/sx/text/md, validated) - [x] list-card summary (`summary.sx`: content/summary — title/excerpt/words/reading/cover) - [x] multi-doc index (`index.sx`: content/index + index-by-tag + all-tags + has-tag?) - [x] nested-tree CvRDT (`crdt-tree.sx`: parent-aware, sections merge collaboratively) - [x] HTML page wrapper (`page.sx`: content/page, escaped title from metadata) - [x] SEO page (`page-full.sx`: content/page-full, lang + meta description from excerpt) - [x] document composition (`compose.sx`: concat/prepend/concat-all/wrap-section) - [x] deep tree editing (`tree-edit.sx`: doc-deep-update/replace/delete/insert-into) - [x] id remapping / clone (`clone.sx`: content/remap-ids + prefix-ids, collision-free compose) - [x] block query + TOC (`query.sx`: content/select/select-type/count-type/headings) - [x] block transforms (`transform.sx`: content/map-blocks/map-type/set-field-on) - [x] TOC rendering (`toc.sx`: content/toc-markdown + toc-html from headings) - [x] anchored-heading render (`anchor.sx`: content/html-anchored, functional TOC links) - [x] document outline (`outline.sx`: content/outline, nested heading tree) - [x] document flatten (`flatten.sx`: content/flatten, un-nest sections; inverse of wrap-section) - [x] relative reorder (`move.sx`: content/move-before/after/to-front/to-back by id) - [x] document normalization (`normalize.sx`: content/normalize, drop empty blocks/sections) - [x] global find/replace (`find-replace.sx`: content/find-replace across text-bearing blocks) - [x] portable data serialization (`data.sx`: content/to-data + from-data, round-trips tree) - [x] wire serialization (`wire.sx`: content/to-wire + from-wire, SX-text on the wire) ## Progress log - 2026-06-07 — Hardening: audit confirmed the persist op-log (store.sx) carries every block type through commit → replay (op-insert carries the block instance; updates apply by id). Locked with +4 store tests (callout/media insert + update via the durable log). No bug; coverage gap closed. Suite 746/746. - 2026-06-07 — Hardening: tree-CRDT orphan reparenting. Concurrent delete-section + insert-child previously orphaned the child (its parent no longer a live section) → silently dropped from materialise. Fixed `crdt-tree-materialize`/`crdt-tree-order` to root any element whose parent is "" OR not a live section, so content is never lost on concurrent edits. +4 tests (orphan survives, commutes, content preserved, renders at root). Suite 742/742. - 2026-06-07 — Hardening: regression suite `crdt-blocks` (7 tests) locking that non-core block types (callout/table/media/section) survive both the flat and nested-tree CvRDT materialise paths (insert → merge → materialise → render), the integration the ct-class-for-type fix repaired. Verified flat + tree, including concurrent mixed-type inserts into a section converging. Suite 738/738. - 2026-06-07 — Hardening: fixed `ct-class-for-type` (block.sx) to map all block tags (added section/table/callout/media). Latent bug: `content/from-data` and CRDT materialise of callout/media blocks failed with "unknown block type" (they fell through to `mk-block`, which only knew the original 8 types). Now all block types build uniformly via mk-block; data/wire/CRDT round-trips of callout/media work. +4 data regression tests; full no-regression gate over the foundational block.sx change: suite 731/731. - 2026-06-07 — Extension: nested-tree CvRDT (`crdt-tree.sx`). Extends the flat CvRDT to a TREE: each element carries a `parent` (containing section id, "" = root) beside its Logoot pos; merge reuses crdt.sx's pos/register/field joins + parent (immutable). Materialisation rebuilds the ordered tree (root + per-section children sorted by pos, recursive). Sections now merge collaboratively; proven commutative/associative/idempotent — same- and different-parent concurrent inserts converge, nested sections, LWW, two-replica convergence. Reuses crdt.sx + section.sx; flat crdt untouched (34/34). 17 tests; suite 727/727. This was the flagged "research-grade" gap — done as a clean self-contained layer. - 2026-06-07 — Extension: multi-document index (`index.sx`). `content/index` projects a doc list into summary cards (blog index); `content/index-by-tag` filters by tag (category pages); `content/all-tags` is a deduped tag cloud; `content/has-tag?`. Composes content/summary + doc metadata. 13 tests; suite 710/710. - 2026-06-07 — Extension: list-card summary (`summary.sx`). `content/summary` returns `{:id :title :excerpt :words :reading-minutes :cover}` for index/listing cards, composing metadata + text + stats + query (`content/cover` = first image's src). Title falls back to id. 14 tests; suite 697/697. - 2026-06-07 — Extension: video/audio media block (`media.sx`). `CtMedia` holds kind (video/audio) + src; answers asHTML (`