Lakehouse Admin
7de4f5d73a
- config/airflow/airflow.cfg (fernet/API keys redacted) + live DAG sync - config/kafka/kraft-server.properties (live KRaft broker on kafka01) - Extend collect-fleet-config.sh for airflow/kafka collection - Add docs/recommendations.md with prioritized next steps
36 lines
924 B
Markdown
36 lines
924 B
Markdown
# Airflow — atc-airflow01
|
|
|
|
| Item | Value |
|
|
|------|-------|
|
|
| Host | `atc-airflow01` / `10.0.21.55` |
|
|
| URL | http://atc-airflow01:8080/ or http://10.0.21.55:8080/ |
|
|
| Home | `/root/airflow/` |
|
|
| Config | `/root/airflow/airflow.cfg` |
|
|
| DAGs | `/root/airflow/dags/` |
|
|
| DB | SQLite (`airflow.db` — not in git) |
|
|
|
|
## Files in git
|
|
|
|
| File | Notes |
|
|
|------|-------|
|
|
| `airflow.cfg` | Reference copy; `fernet_key` and `internal_api_secret_key` redacted |
|
|
| `generate_data_dag.py` | Synced from live DAGs folder |
|
|
| `../airflow/airflow.cfg` | Older path (legacy); prefer this directory |
|
|
|
|
## Restore
|
|
|
|
```bash
|
|
# On atc-airflow01
|
|
mkdir -p /root/airflow/dags
|
|
cp airflow.cfg /root/airflow/
|
|
cp generate_data_dag.py /root/airflow/dags/
|
|
# Set real fernet_key in airflow.cfg or via env
|
|
systemctl restart airflow-webserver airflow-scheduler # if using systemd
|
|
```
|
|
|
|
## Refresh
|
|
|
|
```bash
|
|
./scripts/collect/collect-fleet-config.sh
|
|
```
|