Lakehouse Admin
7de4f5d73a
- config/airflow/airflow.cfg (fernet/API keys redacted) + live DAG sync - config/kafka/kraft-server.properties (live KRaft broker on kafka01) - Extend collect-fleet-config.sh for airflow/kafka collection - Add docs/recommendations.md with prioritized next steps
Airflow — atc-airflow01
| Item | Value |
|---|---|
| Host | atc-airflow01 / 10.0.21.55 |
| URL | http://atc-airflow01:8080/ or http://10.0.21.55:8080/ |
| Home | /root/airflow/ |
| Config | /root/airflow/airflow.cfg |
| DAGs | /root/airflow/dags/ |
| DB | SQLite (airflow.db — not in git) |
Files in git
| File | Notes |
|---|---|
airflow.cfg |
Reference copy; fernet_key and internal_api_secret_key redacted |
generate_data_dag.py |
Synced from live DAGs folder |
../airflow/airflow.cfg |
Older path (legacy); prefer this directory |
Restore
# On atc-airflow01
mkdir -p /root/airflow/dags
cp airflow.cfg /root/airflow/
cp generate_data_dag.py /root/airflow/dags/
# Set real fernet_key in airflow.cfg or via env
systemctl restart airflow-webserver airflow-scheduler # if using systemd
Refresh
./scripts/collect/collect-fleet-config.sh