Files

T

mchusandClaude Opus 4.8 a9924b08b0 feat(scenario): add nvbandwidth-acs-ab, an ACS off/on A/B for cross-socket P2P

Replaces the old nvbandwidth-all-gpu-power-watch scenario (dropped: the
power/IPMI-sampler framing was a dead-end — the blackbox shows every other
load test, incl. NCCL all-reduce across all 6 GPUs, passes with power fully
connected; only nvbandwidth on cross-socket GPU P2P reboots the box).

nvbandwidth-acs-ab is a two-phase reproduction for the MSI CG480-S6053 case.
Phase 1 disables PCIe ACS redirect at runtime via setpci (saving each
bridge's original ACS control word to /run/bee-acs-orig) then runs
nvbandwidth across all 6 GPUs — expected to survive. Phase 2 restores the
saved ACS values and repeats — expected to reproduce the reboot. Safe phase
first so its full blackbox reaches the USB stick before the risky phase can
reset the box (sync-bracket before the final job flushes phase-1 evidence).

ACS mutation runs via `bash -c` since scenario cmd is exec'd directly with no
shell. Both shipped copies (repo scenarios/ and image overlay) identical;
verified both parse via ParseScenarioJSON (4 jobs).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-07-29 13:48:05 +03:00

builder

platform/app: fix nvbandwidth split fallback, blackbox discovery churn, and add blocking sync brackets around load steps

2026-07-28 14:22:05 +03:00

overlay

feat(scenario): add nvbandwidth-acs-ab, an ACS off/on A/B for cross-socket P2P

2026-07-29 13:48:05 +03:00

vendor

iso: update vendor storcli2 to 08.017.000.0008

2026-07-07 18:05:21 +03:00

README.md

iso: pin NVIDIA driver/DCGM to DGX OS 7.5.0-validated combo

2026-07-06 13:33:52 +03:00

README.md

ISO Build

bee ISO is built inside a Debian 12 builder container via iso/builder/build-in-container.sh.

Requirements

Docker Desktop or another Docker-compatible container runtime
Privileged containers enabled
Enough free disk space for builder cache, Debian live-build artifacts, NVIDIA driver cache, and CUDA userspace packages

Build On macOS

From the repository root:

sh iso/builder/build-in-container.sh

The script defaults to linux/amd64 builder containers, so it works on:

Intel Mac
Apple Silicon (M1 / M2 / M3 / M4) via Docker Desktop's Linux VM

You do not need to pass --platform manually for normal ISO builds.

Useful Options

Build with explicit SSH keys baked into the ISO:

sh iso/builder/build-in-container.sh --authorized-keys ~/.ssh/id_ed25519.pub

Force a clean rebuild of the builder image and build caches:

sh iso/builder/build-in-container.sh --clean-build

Use a custom cache directory:

sh iso/builder/build-in-container.sh --cache-dir /path/to/cache

Notes

The builder image is automatically rebuilt if the local tag exists for the wrong architecture.
The live ISO boots with Debian live-boot toram, so the read-only medium is copied into RAM during boot and the runtime no longer depends on the original USB/BMC virtual media staying present.
Target systems need enough RAM for the full compressed live medium plus normal runtime overhead, or boot may fail before reaching the TUI.
The NVIDIA variant installs DCGM 4 packages matched to the CUDA user-mode driver major version. For driver branch 580 / CUDA 13.x, the package family is datacenter-gpu-manager-4-cuda13 rather than legacy datacenter-gpu-manager.
Override the container platform only if you know why:

BEE_BUILDER_PLATFORM=linux/amd64 sh iso/builder/build-in-container.sh

The shipped ISO is still amd64.
Output ISO artifacts are written under dist/.