ATC/Lakehouse
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25 Commits 1 Branch 0 Tags
master
Commit Graph

9 Commits

Author SHA1 Message Date
mo 8eb64381e3 Document lakehouse Debezium connectors and updated docker inventory. 
Add atc-lake01 compose with s3-kafka-consumer; redact DB passwords in connector JSON.
 2026-06-04 02:27:23 +02:00
Lakehouse Admin 58424fccc7 Improve ObjectScale on dashboard and document management_clients 
- Split ObjectScale into UI, S3 API, and SSH tiles on OPS tab
- Add docs/objectscale.md explaining 0.0.0.0/0 and lab ports
- Dedicated Object Storage row in homepage layout
 2026-05-19 23:18:48 +02:00
Lakehouse Admin df5ec93dc3 Full lab documentation and infrastructure as code 
- Trino catalogs, Grafana, Spark jobs, LDAP LDIF, NPM compose
- Airflow DAG scripts, Proxmox VM inventory, network docs
- Ansible playbook, Gitea CI validate workflow
- Backup and health-check scripts, cron documentation
- Homepage DOCS tab with links to all documentation
- Extended collect-fleet-config.sh and populate-repo.py
 2026-05-19 23:12:41 +02:00
Lakehouse Admin 7de4f5d73a Add Airflow and Kafka broker configs to git 
- config/airflow/airflow.cfg (fernet/API keys redacted) + live DAG sync
- config/kafka/kraft-server.properties (live KRaft broker on kafka01)
- Extend collect-fleet-config.sh for airflow/kafka collection
- Add docs/recommendations.md with prioritized next steps
 2026-05-19 23:08:04 +02:00
Lakehouse Admin 007f6cedc5 Document full application landscape and collect Docker configs 
- Add docs/landscape.md and docker-inventory.md with Mermaid architecture
- Add config/docker per host (db02, lake01, kafka01) and objectscale/elastic refs
- Add live architecture page at icons/docs/architecture.html
- Homepage OPS tab: Lakehouse Architecture group with diagram link
- Add scripts/collect/collect-fleet-config.sh to refresh configs from fleet
 2026-05-19 23:01:47 +02:00
Lakehouse Admin e1180e14c9 Remove duplicate setup scripts from docs/ 2026-05-19 22:50:43 +02:00
Lakehouse Admin f0c56f137c Add ObjectScale to SSH mesh (admin bootstrap, root via keys) 
ObjectScale blocks root SSH by default; only admin accepts login.
Bootstrap installs cluster key for admin and root; document in ssh-mesh.md.
 2026-05-19 22:50:32 +02:00
Lakehouse Admin f3d24634e4 English docs and passwordless SSH mesh for lab fleet 
- Translate all documentation to English
- Add docs/ssh-mesh.md and scripts/setup/setup-ssh-mesh.sh
- Add config/hosts/atc-lab.hosts for /etc/hosts on all VMs
- Ignore atc_cluster private key in git; mesh deployed on 12 hosts
 2026-05-19 22:46:40 +02:00
Lakehouse Admin f5d30824fc Docs-as-code: full deploy configs, compose stacks, and DR guide 
- Add root README and docs/ (architecture, hosts, disaster-recovery, operations)
- Add compose/ for superset, forgejo, lam, cadvisor; unified deploy compose
- Add scripts/deploy (deploy-atc-docker01.sh, container inventory export)
- Add inventory/containers-atc-docker01.json snapshot
- Add config READMEs for kafka and airflow; .env.example; expand .gitignore
- Sync atclab helper scripts; update homepage/superset compose with env support
 2026-05-19 22:28:01 +02:00