[ RUST V2 / DURABLE CONTROL PLANE ]

beampipe¶

Discover archive data, prepare reproducible DALiuGE graphs, and operate REST or Slurm execution from one PostgreSQL-backed control plane.

Start locally Configure a backend

API /api/v2 TRUTH PostgreSQL RUNTIME REST or Slurm

Fastest safe start¶

Run the API and durable job system locally. External execution stays mocked until you explicitly enable real backends. The guided path asks one question at a time; the unattended path emits the same neutral installation for automation. Choose a project only when you mean to install one.

[ install.sh ]

CMD curl | sh

LIVE builder

01 / experience

Guided wizard Unattended

Recommended for a first install. Prompts are read from your terminal even though the script arrives through a pipe.

02 / runtime

Docker Compose Host binary

Directory

API port

PostgreSQL

Metrics

03 / project

None neutral Core My project YAML WALLABY HiRes sample

Project config path

Nothing project-specific is installed unless you select it here.

04 / options

Start Core automatically Install Dash Docker only

Username

Email

Password file

Username, email, and a protected password file supplied here take precedence. Leave the file empty and the guided wizard prompts securely. Secrets are never placed in the generated command.

Docker starts Core automatically after setup checks pass.

curl -fsSL https://github.com/jbwod/beampipe-core-v2/releases/latest/download/install.sh | sh -s -- --runtime docker

Guided Docker setup · neutral Core · external execution mocked

After setup: beampipe status, then beampipe doctor. API at http://127.0.0.1:18080/api/v2. Files in ~/beampipe.

01Installpublished SHA-256

02Verifystatus + doctor

03Configureproject + profile

04Activatereal backends explicitly

The installer verifies the release checksum before writing the binary. It generates private local secrets, binds services to loopback by default, and leaves real DALiuGE or Slurm submission off. Continue with the five-minute verification.

How work moves¶

01 / FACTSproject adaptersnamed TAP endpoints

02 / INTENTPostgreSQLconfig + ledger + jobs

03 / EFFECTworkersleased and fenced

04 / RUNTIMEDALiuGEREST DIM or Slurm

Beampipe owns durable intent, preparation artifacts, admission, submission records, and reconciliation. Archives, Slurm, and DALiuGE remain authoritative for their own facts. A successful scheduler submission is therefore never treated as proof of a successful graph.

Choose a task¶

[01] Set upReach a healthy local control plane, then run one source workflow. [02] OperateWatch queues and workers, investigate failures, and recover safely. [03] ConfigureDefine TAP queries, metadata, manifests, graph patches, and automation. [04] DeployConnect an existing DALiuGE DIM or a Slurm facility with strict SSH trust. [05] UnderstandFollow durable state through discovery, preparation, submission, and polling. [06] IntegrateUse the authenticated API workflow and generated schema.