Docs-as-code: full deploy configs, compose stacks, and DR guide

- Add root README and docs/ (architecture, hosts, disaster-recovery, operations)
- Add compose/ for superset, forgejo, lam, cadvisor; unified deploy compose
- Add scripts/deploy (deploy-atc-docker01.sh, container inventory export)
- Add inventory/containers-atc-docker01.json snapshot
- Add config READMEs for kafka and airflow; .env.example; expand .gitignore
- Sync atclab helper scripts; update homepage/superset compose with env support
This commit is contained in:
Lakehouse Admin
2026-05-19 22:28:01 +02:00
parent c63181abac
commit f5d30824fc
30 changed files with 890 additions and 3 deletions
+14
View File
@@ -0,0 +1,14 @@
# Airflow
| Bestand | Beschrijving |
|---------|--------------|
| `airflow.cfg` | Referentie-configuratie (deploy naar Airflow home op lake01) |
| `generate_data_dag.py` | DAG voor demo data-generatie |
## URL
http://atc-lake01.dell-atc.lan:8080/ (of `10.0.21.55:8080` volgens netwerk)
## Deploy
Kopieer `generate_data_dag.py` naar de Airflow `dags/` folder op de lake-host en herstart de scheduler/webserver.
+25
View File
@@ -0,0 +1,25 @@
# Kafka Connect — Debezium connectors
JSON-definities voor CDC van databases naar Kafka.
## Connectors
| Bestand | Bron | Topic prefix |
|---------|------|--------------|
| `postgres-connector.json` | PostgreSQL op db02 | `postgres-sales` |
| `mysql-connector.json` | MySQL | — |
| `mongodb-connector.json` | MongoDB | — |
## Deploy
Vervang `PASSWORD_PLACEHOLDER` en pas host/poort aan. Registreer via Kafka Connect REST API op `atc-lake01` (Debezium `:8083`).
```bash
curl -X POST -H "Content-Type: application/json" \
--data @postgres-connector.json \
http://atc-lake01.dell-atc.lan:8083/connectors/
```
## Referentie
- Kafka UI: http://atc-kafka01.dell-atc.lan:9000/
+3 -1
View File
@@ -5,8 +5,10 @@ services:
restart: unless-stopped
ports:
- "8088:8088"
env_file:
- ../../.env
environment:
- SUPERSET_SECRET_KEY=your-secret-key-here
- SUPERSET_SECRET_KEY=${SUPERSET_SECRET_KEY:-change-me}
- SUPERSET_LOAD_EXAMPLES=no
volumes:
- ./superset_config.py:/app/pythonpath/superset_config.py