Files

T

Lakehouse Admin f3d24634e4 English docs and passwordless SSH mesh for lab fleet

- Translate all documentation to English
- Add docs/ssh-mesh.md and scripts/setup/setup-ssh-mesh.sh
- Add config/hosts/atc-lab.hosts for /etc/hosts on all VMs
- Ignore atc_cluster private key in git; mesh deployed on 12 hosts

2026-05-19 22:46:40 +02:00

2.2 KiB

Raw Permalink Blame History

Disaster recovery

Goal: fully restore the atc-docker01 dashboard stack and configuration from git.

Requirements

VM atc-docker01 with Docker and git
Network to internal .dell-atc.lan hosts
Secrets: .env or existing config/homepage/proxmox.yaml
SSH mesh deployed (ssh-mesh.md) for multi-host config pull

Step 1 — Repository

dnf install -y git docker-compose-plugin
git clone http://atc-mgt01.dell-atc.lan:3001/mo/Lakehouse.git /root/lakehouse
cd /root/lakehouse
cp .env.example .env
# Edit .env: SUPERSET_SECRET_KEY, etc.

Step 2 — Homepage + RSS + icons

docker compose -f deploy/docker-compose.homepage.yml up -d --build
docker exec homepage wget -qO- http://127.0.0.1:3000/api/revalidate

Step 3 — Superset

docker compose -f compose/superset/docker-compose.yaml up -d --build

Step 4 — Optional: Forgejo, LAM, cAdvisor

docker compose -f compose/forgejo/compose.yaml up -d
docker compose -f compose/lam/compose.yml up -d

Or all at once:

./scripts/deploy/deploy-atc-docker01.sh

Step 5 — Other hosts (manual)

This repo holds config references, not full VM images:

Host	Restore from git
Kafka connectors	`config/kafka/*.json` → Connect REST API
Trino	`config/trino/config.properties` → lake host
Spark	`config/spark/spark-defaults.conf`
Airflow	`config/airflow/`
Data scripts	`config/scripts/data-generation/`

See inventory/containers-atc-docker01.json for last exported container state.

Volumes (not in git)

Back up separately:

forgejo_forgejo — Git data
superset_superset_home — Superset metadata
lam_lam — LAM configuration

docker run --rm -v forgejo_forgejo:/data -v /backup:/backup alpine \
  tar czf /backup/forgejo_forgejo.tgz -C /data .

Verification

http://atc-docker01.dell-atc.lan/ — homepage loads, 4 tabs
http://atc-docker01.dell-atc.lan:8090/health — RSS proxy
http://atc-docker01.dell-atc.lan:8088/health — Superset
FEEDS tab shows RSS widgets

Token in config/homepage/proxmox.yaml. After restore, verify in Proxmox → Permissions → API Tokens → root@pam!homepage.

2.2 KiB Raw Permalink Blame History