giles
023bc2d80c
sx: step 3 — add :end and :line to hs tokenizer tokens
...
Extend hs-make-token to (type value pos &rest extras) producing dicts
{:pos :end :line :value :type}. End defaults to pos+len(value); line
defaults to 1. Both tokenize loops now track current-line via newline
counting in advance!. hs-emit! and t-emit! pass the right end and
start-line to the constructor; redundant dict-set! after construction
removed.
Mirror copied to shared/static/wasm/sx/hs-tokenizer.sx (byte-identical).
Verify: (hs-make-token "NUMBER" "1" 0) returns
{:pos 0 :end 1 :line 1 :value "1" :type "NUMBER"}.
OCaml suite: 4529 pass, 1339 pre-existing failures (baseline). All
4/4 hs-upstream-core/sourceInfo tests now pass (was 2/4 — closes E38).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-05-06 22:14:10 +00:00
..
2026-04-13 08:26:48 +00:00
2026-04-17 12:53:09 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 12:18:41 +00:00
2026-04-11 08:52:36 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 12:18:41 +00:00
2026-04-11 08:52:36 +00:00
2026-04-01 23:19:25 +00:00
2026-04-16 22:15:55 +00:00
2026-04-17 12:53:09 +00:00
2026-04-01 23:19:25 +00:00
2026-04-16 14:00:12 +00:00
2026-04-17 12:53:09 +00:00
2026-04-01 23:19:25 +00:00
2026-04-16 17:08:01 +00:00
2026-04-17 12:53:09 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 00:08:00 +00:00
2026-04-04 17:11:12 +00:00
2026-04-01 23:19:25 +00:00
2026-04-12 08:41:38 +00:00
2026-04-12 08:41:38 +00:00
2026-04-01 23:19:25 +00:00
2026-04-11 12:49:57 +00:00
2026-04-11 12:49:57 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 22:52:41 +00:00
2026-04-05 21:18:14 +00:00
2026-04-01 23:19:25 +00:00
2026-04-23 16:53:06 +00:00
2026-04-17 12:53:09 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 21:31:17 +00:00
2026-04-11 08:52:36 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 22:52:41 +00:00
2026-04-05 13:28:17 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 12:18:41 +00:00
2026-04-05 14:38:28 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 12:18:41 +00:00
2026-04-04 17:11:12 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 00:08:00 +00:00
2026-04-08 21:44:58 +00:00
2026-04-01 23:19:25 +00:00
2026-04-05 11:05:17 +00:00
2026-05-06 13:09:17 +00:00
2026-04-22 09:09:56 +00:00
2026-04-15 11:56:15 +00:00
2026-04-18 07:21:41 +00:00
2026-05-06 18:51:32 +00:00
2026-04-22 09:09:56 +00:00
2026-05-06 13:09:17 +00:00
2026-04-22 09:09:56 +00:00
2026-05-06 18:54:06 +00:00
2026-04-22 09:09:56 +00:00
2026-05-06 22:14:10 +00:00
2026-04-22 09:09:56 +00:00
2026-04-04 12:18:41 +00:00
2026-04-04 17:11:12 +00:00
2026-04-01 23:19:25 +00:00
2026-04-22 09:09:56 +00:00
2026-04-16 17:08:01 +00:00
2026-04-18 07:33:05 +00:00
2026-04-18 07:33:05 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 00:08:00 +00:00
2026-04-04 17:11:12 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 00:08:00 +00:00
2026-04-04 17:11:12 +00:00
2026-04-01 23:19:25 +00:00
2026-04-05 21:18:14 +00:00
2026-04-08 21:44:58 +00:00
2026-04-01 23:19:25 +00:00
2026-04-04 12:18:41 +00:00
2026-04-11 08:52:36 +00:00
2026-04-01 23:19:25 +00:00
2026-04-12 18:31:34 +00:00
2026-04-12 18:31:34 +00:00
2026-04-02 11:31:57 +00:00
2026-04-02 11:31:57 +00:00
2026-04-16 17:08:01 +00:00
2026-04-02 11:31:57 +00:00
2026-04-02 11:31:57 +00:00
2026-04-16 17:08:01 +00:00
2026-04-02 09:37:58 +00:00
2026-04-08 21:44:58 +00:00
2026-04-16 17:08:01 +00:00
2026-04-08 21:44:58 +00:00
2026-04-08 21:44:58 +00:00
2026-04-01 23:19:25 +00:00