Docs-as-code: full deploy configs, compose stacks, and DR guide
- Add root README and docs/ (architecture, hosts, disaster-recovery, operations) - Add compose/ for superset, forgejo, lam, cadvisor; unified deploy compose - Add scripts/deploy (deploy-atc-docker01.sh, container inventory export) - Add inventory/containers-atc-docker01.json snapshot - Add config READMEs for kafka and airflow; .env.example; expand .gitignore - Sync atclab helper scripts; update homepage/superset compose with env support
This commit is contained in:
@@ -0,0 +1,14 @@
|
||||
# Airflow
|
||||
|
||||
| Bestand | Beschrijving |
|
||||
|---------|--------------|
|
||||
| `airflow.cfg` | Referentie-configuratie (deploy naar Airflow home op lake01) |
|
||||
| `generate_data_dag.py` | DAG voor demo data-generatie |
|
||||
|
||||
## URL
|
||||
|
||||
http://atc-lake01.dell-atc.lan:8080/ (of `10.0.21.55:8080` volgens netwerk)
|
||||
|
||||
## Deploy
|
||||
|
||||
Kopieer `generate_data_dag.py` naar de Airflow `dags/` folder op de lake-host en herstart de scheduler/webserver.
|
||||
@@ -0,0 +1,25 @@
|
||||
# Kafka Connect — Debezium connectors
|
||||
|
||||
JSON-definities voor CDC van databases naar Kafka.
|
||||
|
||||
## Connectors
|
||||
|
||||
| Bestand | Bron | Topic prefix |
|
||||
|---------|------|--------------|
|
||||
| `postgres-connector.json` | PostgreSQL op db02 | `postgres-sales` |
|
||||
| `mysql-connector.json` | MySQL | — |
|
||||
| `mongodb-connector.json` | MongoDB | — |
|
||||
|
||||
## Deploy
|
||||
|
||||
Vervang `PASSWORD_PLACEHOLDER` en pas host/poort aan. Registreer via Kafka Connect REST API op `atc-lake01` (Debezium `:8083`).
|
||||
|
||||
```bash
|
||||
curl -X POST -H "Content-Type: application/json" \
|
||||
--data @postgres-connector.json \
|
||||
http://atc-lake01.dell-atc.lan:8083/connectors/
|
||||
```
|
||||
|
||||
## Referentie
|
||||
|
||||
- Kafka UI: http://atc-kafka01.dell-atc.lan:9000/
|
||||
@@ -5,8 +5,10 @@ services:
|
||||
restart: unless-stopped
|
||||
ports:
|
||||
- "8088:8088"
|
||||
env_file:
|
||||
- ../../.env
|
||||
environment:
|
||||
- SUPERSET_SECRET_KEY=your-secret-key-here
|
||||
- SUPERSET_SECRET_KEY=${SUPERSET_SECRET_KEY:-change-me}
|
||||
- SUPERSET_LOAD_EXAMPLES=no
|
||||
volumes:
|
||||
- ./superset_config.py:/app/pythonpath/superset_config.py
|
||||
|
||||
Reference in New Issue
Block a user