Files
LithosAnanke/docs/v4.0.0/plans/2026-11-13-engine-step4-phase1-v4-in-the-kernels-boot.md
T
Claude 046ce0be65 feat(v4): the mesh boot to spec -- Hera born empty in the kernel's fabric; births, kills, every node stepping together (#189)
ENGINE step 4 Phase 1, Tasks 5b-5d, and the edge cases (Captain Bob, 2026-11-13: "Build it to proper
spec"; "Check for the edge cases"; "Yes, add it to v4-checks").

- v4/system/mesh.c, v4/include/v4/mesh.h: the nucleus assembled by the ROM and given to Hera as F18
  cells; Hera born empty at place 0, the kernel on port 0, the console on port 1; told she is 10, in the
  registry, the kernel's words, FORTH-79, sealed, POST, the kernel's capsules. NODE-BORN / NODE-KILL in
  the owner's room.
- No scheduler: v4_mesh_tell returns once the node told says how its text ended, and
  v4_mesh_step / v4_mesh_busy let the host step the fabric while it waits, so nodes run between
  lines as during them. A text left "waiting" is owed its end: the next line ends it "Interrupted"
  and is then run (MESH.md 7b.6).
- kernel: sk_v4.c boots through the mesh; its idle steps the fabric while a node can run, and halts
  only when none can (#151 kept). stadium_return_quota and stadium_ops_forget on a kill.
- Tests: v4/tests/test_mesh_boot.c (32 checks: the boot, births, kills, rebirth, a live number, a
  fault, no such node, Hera not killing herself, no room, a line too long, a node running for ever,
  a wait broken by the next line), run by `make -C v4 test` and under ASan+UBSan by `sanitize`
  (v4-checks); kernel/tests quota return; scripts/qemu_session.py births() and the edges on bare
  metal.
- Docs: ENGINE.md 6 "who runs next" struck (settled: no scheduler); the Phase 1 plan; FABRIC-3
  XLVIII.23; .claude/memory/rules.md: alpha.5 closed to new work.
- Evidence: v4-checks 80 programs under the sanitizers, 0 failures; the hosted builds alike; two
  stopped v4-checks runs labelled STOPPED; three development amd64 boots labelled.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_017RzZgrf7V7Zk2iczBXDRbm
2026-11-13 17:00:08 +00:00

14 KiB

ENGINE Step 4, Phase 1: v4 in the kernel's boot -- Plan

For agentic workers: steps use checkbox (- [ ]) syntax. One QEMU at a time, in the foreground (.claude/CLAUDE.md); every log and CSV is committed.

Goal (#189): on bare metal, v4 boots in the kernel's boot, not before it: the kernel's own order, as v3's -- hardware, the heartbeat, the Stadium, then the v4 system on the first node (Hera) with POST, then the devices, then the prompt -- and the Stadium holds Hera from the start, so that Phase 2 can feed it every word Hera calls. sk_v4_run(), which today takes the boot before the Stadium is made and never returns (kernel_main.c:647), goes.

Parent plan: 2026-10-20-engine-step4-node-in-the-vms-place.md, Phase 1 (rows 1, 2, 5, 6 and 9 of V3-PARITY.md section 1). Order ruled 2026-11-12 (Captain Bob, #189): Part A (done), Phase 1, Phase 2, then Phase 7. HEAT-OP's Stadium feed was ruled into this phase ("Both": the registers now -- built 2026-11-12 -- and the Stadium feed in Phase 1, measured, kept or reverted on the numbers).

What a v4 boot does today, and what v3's does

v3 (system=v3) v4 today
Heartbeat started (kernel_main_deep) started -- the same code, before the choice
The Stadium stadium_boot_init, session_boot_init, stadium_birth_hera, stadium_words_init, stadium_blocks_init -- "Stadium: 83886 cells (5242 KB), 50 VM slots" never made: sk_v4_run() is called before it and does not return
The system the v3 VM, POST one node, POST (v4_boot_run)
The checks after POST "Stadium words: promotions=...", "Stadium conservation: ... CONSERVED", "Stadium quota grant self-test: OK", "Heartbeat: N ticks" none
Devices PCI, the disk the block chain, after POST (sk_v4_block_chain)
The prompt sk_repl() sk_v4_run()'s own loop

Rulings (Captain Bob, 2026-11-13)

  • Q1: "A new node key." The Stadium is keyed by v4 node number now, ahead of the fleet -- not by vm_uuid_hera(). A node's key is made from its number (stadium_node_key(node), a VMUuid that no v3 VM can have); the node the kernel brings up first, Hera -- node 10, as the hosted mesh numbers her (test_host_unit.c: "it is told it is 10") -- is patron zero under her key. v3's path keeps vm_uuid_hera() and stadium_birth_hera() unchanged (MACHINE.md 7 item 3); the v4 path gets stadium_birth_node(key), the same birth for a key it is given.
  • Q2: per heartbeat tick, as recommended.
  • Q3: "All of v3's." A v4 boot runs every boot check v3's does that is not v3's VM itself: the Stadium, the session table, the switch-signal table, kernel-Hermes' channels and queues, Hera's birth, the word and block layers; and after POST the conservation check, the quota grant self-test and the heartbeat's tick line.
  • Q4: "In Phase 1." The registry (v4/src/manage.c) comes into the kernel build in this phase: Task 5 is in. Asked how much -- it needs a fabric of nodes, births that make them, and who runs next (ENGINE.md 6, open) -- "Full births now."
  • Who runs next (ENGINE.md 6): "Hera by compudynamics now." Withdrawn 2026-11-13 -- the question was put wrongly, as a choice of scheduling policy. The design has no scheduler (JUSTIFICATION.md 4: "There is no scheduler to write"; fabric.h: "There is no choice of whose turn it is"; FABRIC-3's turn-attractor: "fix the gap without a scheduler"): every awake node steps together, and a node with nothing to do waits at a port. Captain Bob, asked "Scheduler? Have we regressed?", then: "Build it to proper spec." The withdrawn ruling, as it was written: As v3's turn-attractor, agreed with Captain Bob (FABRIC-3.md, the turn-attractor: "the next turn to whichever live identity VM currently has the lowest execution_heat_q48 ... No priority levels, no time slices, no preemption -- the same density comparison Stadium already uses"): the next instruction word goes to the coolest awake node that can run, by its resident heat in the Stadium -- its opcode patrons (Task 3) until Phase 2 adds its words. Switching only between instruction words (ENGINE.md 3a). A node asleep at its wires, or blocked, is not a candidate.

Questions (as they were put)

Q1. Hera's place in the Stadium. Recommend: the v4 node is Hera, patron zero, under vm_uuid_hera(): stadium_birth_hera() as v3 has it, and its session. The Stadium's own code is the kernel's and unchanged (Q3 of 2026-10-20: "keyed by node number where they are keyed by VM today" -- with one node, Hera's UUID is that key until the fleet, Phase 5 onward).

Q2. The opcode patrons: how a count becomes heat. The Stadium's heat is a conserved share of 1.0, not a count. Recommend: 32 opcode patrons for the node, one per opcode, admitted at boot as the word layer admits words (stadium_words.c), behaviour COOL; at each heartbeat tick, not at each instruction, each opcode's retirements since the last tick (v4_heat.op[k]'s delta) are charged as that many of the word layer's dispatches -- the same pull from the node's reservoir, the same cooling per tick -- in one step. Per instruction it would be a kernel call per instruction (the "huge performance hit" the ruling allows to be reverted); per tick it is 32 sums a tick. Measured either way (Task 3). If not: charged per instruction, at the hook in v4/src/exec.c -- then measured, and reverted if it is the hit.

Q3. Which of v3's boot checks a v4 boot runs. Recommend: those of the Stadium and the heartbeat, which are the kernel's: the Stadium's allocation, Hera's birth, the word and block layers, and after POST the conservation check (stadium_words_print_boot_diagnostics), the quota grant self-test and the heartbeat's tick line. Not v3's switch-signal table, kernel-Hermes' channels and queues, or the v3 VM's own Stadium step lines: they are a v3 VM's (Q1 of 2026-10-20: Hermes is v4's wires, not kernel_hermes.c).

Q4. The registry (v4/src/manage.c, MESH step 9) in this phase or after alpha.5. The parent plan puts it in Phase 1; the physics does not need it -- one node, Hera, is enough for Phases 2 and 7. Recommend: after alpha.5, with the fleet (Phase 5 onward), to keep #189's path short. If not: Task 5 below.

Tasks

Task 1: The Stadium before the system

Files: kernel/src/kernel_main.c. Test: the amd64 boot (an acceptance check, Task 4).

  • Step 1: Seen to fail first: the acceptance check of Task 4, on today's build: a v4 boot has no "Stadium: ... cells" line.
  • Step 2: stadium_boot_init, session_boot_init, sk_vm_switch_signal_boot_init, sk_hermes_channels_boot_init, sk_hermes_queues_boot_init move above the choice of system -- the kernel's, for both systems, in v3's order (Q3). Then on v3's path stadium_birth_hera() as today; on v4's, stadium_birth_node(stadium_node_key(10)) (Q1, a failing host test first: kernel/tests/test_stadium_node.c -- the key is no v3 VM's, the node lands on cell 0, its session is registered and pinned). Then stadium_words_init and stadium_blocks_init. v3's path is otherwise unchanged (MACHINE.md 7 item 3): the same calls, in the same order, before its VM.
  • Step 3: the three boots and the stick, v4: "Stadium: N cells (... KB), 50 VM slots" before the system starts; POST and dict_hash unchanged (the node is not touched). One system=v3 boot, for v3's path: the same lines it printed before.

Task 2: sk_v4_run() goes

Files: kernel/src/v4/sk_v4.c, kernel/include/starkernel/v4/sk_v4.h, kernel/src/kernel_main.c.

  • Step 1: sk_v4_run() becomes two: sk_v4_boot() -- the node, POST, the blocks, the identity; it returns -- and sk_v4_prompt(), the prompt loop, which does not. The kernel calls them in its own order: the Stadium (Task 1), sk_v4_boot(), the checks after POST (Q3), then sk_v4_prompt().
  • Step 2: the checks after POST on v4, under Hera's node key: "Stadium words: ...", "Stadium conservation: ... CONSERVED", "Stadium quota grant self-test: OK", the heartbeat's tick line (Q3).
  • Step 3: the three boots and the stick: those lines, then [zuse@Hera] ok> ; POST and dict_hash unchanged.

Task 3: The opcode patrons (HEAT-OP into the Stadium), measured

Files: kernel/src/vm/stadium_ops.c (new), its header, kernel/src/v4/sk_v4.c (the tick). Test: kernel/tests/test_stadium_ops.c (the host harness, make -C kernel/tests), with the Stadium's own sources.

  • Step 1: Failing test: 32 patrons admitted for a node; N retirements of an opcode between two ticks heat its patron as N of the word layer's dispatches would; the sum of the node's resident heat and its reservoir stays 1.0 (stadium_conserved); no retirements, no heat; cooling per tick as words.
  • Step 2: stadium_ops.c, as ruled in Q2; the heartbeat's tick charges the deltas.
  • Step 3: a line after POST, "Stadium opcodes: ..." (the hottest opcodes), and conservation still CONSERVED with them in.
  • Step 4: Measured: the amd64 boot's time and POST's instruction count, with and without the feed, five boots each -- recorded in the commit. Kept, or reverted on the numbers (Captain Bob, 2026-11-12).

Task 4: Acceptance asserts it

Files: scripts/qemu_session.py (the v4 boot's checks), scripts/nightly.sh (the stages read them).

  • Step 1: a v4 acceptance boot must show "Stadium: ... cells", "Stadium conservation: ... CONSERVED" and the heartbeat's line before its prompt; one without them fails (#189 Done when, third item: "a boot without the physics fails"). Seen to fail on today's build (Task 1 Step 1).
  • Step 2: the protocol, all eight stages; then the push, on Captain Bob's word.

Task 5: the registry and births, to spec

5a's "Hera as now, in a fabric" is superseded for births (2026-11-13): with Hera booted by v4_boot_run, her messages to a child are answered "no one is there" (boot.c speaks only her console's wire) and nothing runs a child while the boot drives her. To spec -- MESH.md 9, MACHINE.md 3, and as v4/tests/test_host_unit.c already does on the host -- Hera is born empty in the kernel's fabric, and every node steps together (v4_fabric_step). No scheduler.

  • 5a. The registry (2026-11-13; f10d2bc8): Hera at place 0, entered as node 10; centre.4th and hera.4th; NODE-ME. Kept; its boot is replaced by 5b.

  • 5b. The mesh boot -- v4/system/mesh.c (new), the kernel's boot of the fabric, a host test first (v4/tests/test_host_meshboot.c, 64-bit cells, as test_host_unit.c):

    1. the nucleus: the machine's ROM assembles the system on a node of its own (boot.c's load_system, shared); written as a capsule of F18 cells (v4_capsule_write) -- "a node that is born is given assembled code, never the source" (Captain Bob, 2026-10-15);
    2. Hera born empty at place 0 of the fabric: the kernel on her port 0 (it gives her the nucleus a cell at a time, and takes her requests -- blocks, the kernel's words, the registry), the console on her port 1 (whole messages); stepped until she sleeps at her wires;
    3. told she is 10 and where the console is; entered in the registry; the kernel's words; forth79.4th a line at a time; sealed; POST (v4_post_run, its lines as messages); the kernel's capsules (centre.4th, hera.4th); sealed;
    4. the same parity lines as v4_boot_run prints, so acceptance reads a mesh boot as it read the other;
    5. a line from the console is a message to node 10; what any node prints comes back as messages; how it ended is said; KEY reads her console registers, fed by the host;
    6. births: NODE-BORN makes a node in room the owner gives, carrying the mesh ROM, wired to the kernel on its port 0 for its blocks; NODE-KILL gives the room back. CAPSULE-OPEN of v4:nucleus-64.f18 reads the nucleus a cell at a time. The test: the parity lines; POST passes; NODE-ME . 0; KEY; 11 2 2 BIRTH -- node 11 takes in the nucleus and FORTH-79 and answers a line; 11 KILL.
  • 5c. The kernel boots by it (sk_v4.c): the prompt's lines go to node 10 as messages; the identity gate, the block chain after POST, the heartbeat's service; a born node's room from the kernel's heap, its Stadium quota granted from Hera's under its node key (stadium_node_key), its opcode patrons charged with Hera's; its quota given back when it is killed. The hosted product keeps v4_boot_run; boot.h's "differ only in where the text goes" is corrected.

  • 5d. Acceptance: a boot births a node from Hera, it answers a line, Hera kills it, the Stadium CONSERVED after; then the protocol.

    Built (2026-11-13). 5b: v4/system/mesh.c, v4/include/v4/mesh.h; boot.c shares v4_boot_assemble (which v4_boot_run now calls), v4_boot_capsule and its number printing; the image carries (ME)'s address. v4/tests/test_mesh_boot.c (in make -C v4 test): failed first (no mesh.c), then 16 checks -- POST 539/539, NODE-ME 0, 11 2 2 BIRTH, node 11 answers directly and through Hera, 11 KILL. 5c: sk_v4.c boots by it -- 16 places, a born node's room from the kernel's heap, its Stadium quota under its node key granted from Hera's on its first charge and given back when it is killed (stadium_return_quota, stadium_ops_forget: failed first, then test_stadium_ops 20 checks); every node's opcodes charged. A line that waits for an answer is broken by the next line, as a message (MESH.md 7b.6). 5d: qemu_session.py births(). The amd64 boot: 160 s (about 90 s before -- POST and the lines now go as messages); dict_hash changes (Hera is told she is 10).

What this phase does not do

Phase 2 (the word accounts at call: the kernel's record per word, execution_heat, stadium_word_dispatch, the ACL's countdown) and Phase 7 (decay, the rolling window, pipelining, inference, L8 on those records). After Phase 1 the Stadium holds Hera and her 32 opcode patrons, and nothing yet of her words.

Review focus

  1. v3's path: a system=v3 boot prints what it printed before, in the same order.
  2. The 32-bit build and the stick: the Stadium's allocation fits the stick loaded high as it does at 2 GiB.
  3. Conservation with the opcodes in: K = 1.0 after POST, before the prompt.
  4. The tick's cost: with the feed, the heartbeat still keeps its rate (its tick line's count against the boot's time).