ci: nightly images, nightly documents and tagged releases, in the tree
scripts/nightly.sh, one stage per call, a step each in the workflows:
accept <amd64|aarch64|riscv64|stick-high> the acceptance protocol --
qemu_session.py zuse, and stick_zuse --target qemu-stick-high;
after the last, dict_hash must be equal on the three
test-32 make -C v4 test-32
proofs isabelle build -c -D proof/ (StarForth checked afresh each run)
images the Pi 5 and Mars images, xz for Raspberry Pi Imager
publish org.starship:kernelImage: pc (iso), raspi5, milkv (img.xz),
logs (tar.gz: this run's serial logs, proof log, DoE CSVs)
docs, publish-docs book, vol1-3, api -> org.starship:documentation
.gitea/workflows/nightly.yml (03:00) and nightly-docs.yml (04:00) publish
<LITHOS_VERSION>-SNAPSHOT to starshipos-snapshots; release.yml, on a tag
v*, builds and publishes both to starshipos-releases at the tag's version,
refusing a tag that is not v<LITHOS_VERSION>. Until this branch is merged
to master, master carries copies of the two nightlies naming it.
make init: INIT_DOCS=0 leaves out TeX and Doxygen, INIT_PROOFS=0 Isabelle.
Checked here, stage by stage, in order: the four acceptance boots PASS,
dict_hash 0xfec8c47cfc6f437f on the three, test-32 0 failures, StarForth
proved (0:00:41), images built; publish to a local file:// repository,
and the images' publish to Nexus starshipos-snapshots read back byte for
byte. The docs stage and publish-docs: not yet checked when committed.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GE3SDvQn5EoxdGufk84zz2
This commit is contained in:
rajames
co-authored by
Claude Opus 5.5
Claude Opus 5.5
parent
deb71faeb2
commit
a5a29cc857
@@ -0,0 +1,47 @@
|
||||
# Nightly snapshot of the documents: the book, the formal volumes and the API reference
|
||||
# (scripts/nightly.sh docs), then Nexus.
|
||||
#
|
||||
# org.starship:documentation:<LITHOS_VERSION>-SNAPSHOT, starshipos-snapshots
|
||||
# classifier book the book (make docs)
|
||||
# classifier vol1, vol2, vol3 the formal volumes (make -C docs/formal vols)
|
||||
# classifier api the API reference (make -C docs/formal doxygen)
|
||||
#
|
||||
# Gitea runs a schedule from the default branch. Until StarForth-v4.0.0 is merged to master,
|
||||
# master carries a copy of this file whose checkout names that branch.
|
||||
name: Nightly documents
|
||||
|
||||
on:
|
||||
schedule:
|
||||
- cron: '0 4 * * *' # 04:00 UTC, after the images (nightly.yml, 03:00)
|
||||
workflow_dispatch:
|
||||
|
||||
jobs:
|
||||
docs:
|
||||
name: Book, volumes, API reference
|
||||
runs-on: ubuntu-latest
|
||||
timeout-minutes: 90
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
with:
|
||||
fetch-depth: 0
|
||||
lfs: false
|
||||
|
||||
- name: Install the documents' dependencies
|
||||
run: |
|
||||
make ARCH=amd64 init INIT_PROOFS=0
|
||||
DEBIAN_FRONTEND=noninteractive apt-get install -y -qq maven default-jre-headless
|
||||
|
||||
- name: Documents
|
||||
run: scripts/nightly.sh docs
|
||||
|
||||
- name: Publish to Nexus
|
||||
env:
|
||||
NEXUS_USER: ci-publisher
|
||||
NEXUS_PASSWORD: ${{ secrets.NEXUS_CI_PASSWORD }}
|
||||
run: scripts/nightly.sh publish-docs https://nexus.starshipos-f18.org/repository/starshipos-snapshots
|
||||
|
||||
- name: Keep the documents
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: documents-${{ github.run_number }}
|
||||
path: build/nightly-docs/
|
||||
@@ -0,0 +1,71 @@
|
||||
# Nightly snapshot of the kernel images: the acceptance protocol, the proofs, the board images,
|
||||
# then Nexus. Each stage is a step of scripts/nightly.sh (its header says what each does); any
|
||||
# failure stops the run, and nothing is published unless every stage before it passed.
|
||||
#
|
||||
# org.starship:kernelImage:<LITHOS_VERSION>-SNAPSHOT, starshipos-snapshots
|
||||
# classifier pc StarshipOS.iso amd64, UEFI -- the ISO the amd64 acceptance boot booted
|
||||
# classifier raspi5 raspi5.img.xz Raspberry Pi 5, for Raspberry Pi Imager
|
||||
# classifier milkv MilkV.img.xz Milk-V Mars
|
||||
# classifier logs logs.tar.gz this run's serial logs, proof log and DoE CSVs
|
||||
#
|
||||
# Gitea runs a schedule from the default branch. Until StarForth-v4.0.0 is merged to master,
|
||||
# master carries a copy of this file whose checkout names that branch.
|
||||
name: Nightly snapshot
|
||||
|
||||
on:
|
||||
schedule:
|
||||
- cron: '0 3 * * *' # 03:00 UTC; the documents are at 04:00 (nightly-docs.yml)
|
||||
workflow_dispatch:
|
||||
|
||||
jobs:
|
||||
nightly:
|
||||
name: Acceptance, proofs, images
|
||||
runs-on: ubuntu-latest
|
||||
timeout-minutes: 150
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
with:
|
||||
fetch-depth: 0 # the SBOM's version is git describe
|
||||
lfs: false # only the logs and DoE CSVs are in LFS; the build needs neither
|
||||
|
||||
- name: Install the build's dependencies
|
||||
run: |
|
||||
make ARCH=amd64,aarch64,riscv64 init INIT_DOCS=0
|
||||
DEBIAN_FRONTEND=noninteractive apt-get install -y -qq maven default-jre-headless
|
||||
|
||||
- name: Acceptance amd64
|
||||
run: scripts/nightly.sh accept amd64
|
||||
- name: Acceptance aarch64
|
||||
run: scripts/nightly.sh accept aarch64
|
||||
- name: Acceptance riscv64
|
||||
run: scripts/nightly.sh accept riscv64
|
||||
- name: Acceptance PC stick loaded high
|
||||
run: scripts/nightly.sh accept stick-high
|
||||
- name: Acceptance 32-bit build
|
||||
run: scripts/nightly.sh test-32
|
||||
- name: Isabelle/HOL proofs
|
||||
run: scripts/nightly.sh proofs
|
||||
|
||||
- name: Images
|
||||
run: scripts/nightly.sh images
|
||||
|
||||
- name: Publish to Nexus
|
||||
env:
|
||||
NEXUS_USER: ci-publisher
|
||||
NEXUS_PASSWORD: ${{ secrets.NEXUS_CI_PASSWORD }}
|
||||
run: scripts/nightly.sh publish https://nexus.starshipos-f18.org/repository/starshipos-snapshots
|
||||
|
||||
- name: Keep the images
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: kernel-images-${{ github.run_number }}
|
||||
path: build/nightly/
|
||||
|
||||
- name: Keep the logs and DoE CSVs
|
||||
if: always()
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: logs-${{ github.run_number }}
|
||||
path: |
|
||||
logs/
|
||||
experiments/bare_metal/runs/
|
||||
@@ -0,0 +1,79 @@
|
||||
# A release: pushing a tag v<version> builds that commit exactly as the nightly does -- the
|
||||
# acceptance protocol, the proofs, the board images -- and the documents, and publishes both to
|
||||
# starshipos-releases at that version:
|
||||
#
|
||||
# org.starship:kernelImage:<version> classifiers pc, raspi5, milkv, logs (nightly.yml)
|
||||
# org.starship:documentation:<version> classifiers book, vol1, vol2, vol3, api (nightly-docs.yml)
|
||||
#
|
||||
# The tag must name the version the tree says it is: v<LITHOS_VERSION> (kernel/Makefile). A tag
|
||||
# that does not is refused before anything is built. A release repository takes a version once.
|
||||
name: Release
|
||||
|
||||
on:
|
||||
push:
|
||||
tags: ['v*']
|
||||
|
||||
jobs:
|
||||
release:
|
||||
name: Release ${{ github.ref_name }}
|
||||
runs-on: ubuntu-latest
|
||||
timeout-minutes: 240
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
with:
|
||||
fetch-depth: 0
|
||||
lfs: false
|
||||
|
||||
- name: The tag names the tree's version
|
||||
run: |
|
||||
tree="v$(sed -n 's/^LITHOS_VERSION *?= *//p' kernel/Makefile)"
|
||||
echo "tag ${{ github.ref_name }}, kernel/Makefile LITHOS_VERSION -> $tree"
|
||||
[ "${{ github.ref_name }}" = "$tree" ] || { echo "The tag must be $tree, or LITHOS_VERSION changed first."; exit 1; }
|
||||
echo "NIGHTLY_VERSION=${tree#v}" >> "$GITHUB_ENV"
|
||||
|
||||
- name: Install the dependencies
|
||||
run: |
|
||||
make ARCH=amd64,aarch64,riscv64 init
|
||||
DEBIAN_FRONTEND=noninteractive apt-get install -y -qq maven default-jre-headless
|
||||
|
||||
- name: Acceptance amd64
|
||||
run: scripts/nightly.sh accept amd64
|
||||
- name: Acceptance aarch64
|
||||
run: scripts/nightly.sh accept aarch64
|
||||
- name: Acceptance riscv64
|
||||
run: scripts/nightly.sh accept riscv64
|
||||
- name: Acceptance PC stick loaded high
|
||||
run: scripts/nightly.sh accept stick-high
|
||||
- name: Acceptance 32-bit build
|
||||
run: scripts/nightly.sh test-32
|
||||
- name: Isabelle/HOL proofs
|
||||
run: scripts/nightly.sh proofs
|
||||
- name: Images
|
||||
run: scripts/nightly.sh images
|
||||
- name: Documents
|
||||
run: scripts/nightly.sh docs
|
||||
|
||||
- name: Publish to Nexus
|
||||
env:
|
||||
NEXUS_USER: ci-publisher
|
||||
NEXUS_PASSWORD: ${{ secrets.NEXUS_CI_PASSWORD }}
|
||||
run: |
|
||||
scripts/nightly.sh publish https://nexus.starshipos-f18.org/repository/starshipos-releases
|
||||
scripts/nightly.sh publish-docs https://nexus.starshipos-f18.org/repository/starshipos-releases
|
||||
|
||||
- name: Keep the release
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: release-${{ github.ref_name }}
|
||||
path: |
|
||||
build/nightly/
|
||||
build/nightly-docs/
|
||||
|
||||
- name: Keep the logs and DoE CSVs
|
||||
if: always()
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: release-logs-${{ github.ref_name }}
|
||||
path: |
|
||||
logs/
|
||||
experiments/bare_metal/runs/
|
||||
Reference in New Issue
Block a user