Full lab documentation and infrastructure as code

- Trino catalogs, Grafana, Spark jobs, LDAP LDIF, NPM compose
- Airflow DAG scripts, Proxmox VM inventory, network docs
- Ansible playbook, Gitea CI validate workflow
- Backup and health-check scripts, cron documentation
- Homepage DOCS tab with links to all documentation
- Extended collect-fleet-config.sh and populate-repo.py
This commit is contained in:
Lakehouse Admin
2026-05-19 23:12:41 +02:00
parent 3c8993a41e
commit df5ec93dc3
46 changed files with 1809 additions and 74 deletions
+19
View File
@@ -0,0 +1,19 @@
# Trino — atc-lake01
| Item | Value |
|------|-------|
| UI | http://atc-lake01:8089/ui/ |
| Container | `trino` (Docker) |
| Catalogs | `catalog/*.properties` |
## Catalogs
| File | Connector | Source |
|------|-----------|--------|
| `postgres_sales.properties` | PostgreSQL | atc-db02:5432 |
| `mysql_hr.properties` | MySQL | atc-db02:3306 |
| `mongodb_supplychain.properties` | MongoDB | atc-db02:27017 |
| `cassandra_telemetry.properties` | Cassandra | atc-db02:9042 |
| `iceberg.properties` | Iceberg | ObjectScale S3 `10.0.20.111:9020` |
Passwords redacted in git. Refresh: `./scripts/collect/collect-fleet-config.sh`
@@ -0,0 +1,11 @@
connector.name=cassandra
cassandra.contact-points=10.0.21.51
cassandra.native-protocol-port=9042
# Required DC setting for load balancing:
cassandra.load-policy.dc-aware.local-dc=datacenter1
# If Cassandra auth is enabled, uncomment and set:
# cassandra.username=mo
# cassandra.password=REDACTED
+10
View File
@@ -0,0 +1,10 @@
connector.name=iceberg
iceberg.catalog.type=TESTING_FILE_METASTORE
hive.metastore.catalog.dir=/tmp/iceberg_metadata
# S3 Connectivity
hive.s3.endpoint=http://10.0.20.111:9020
hive.s3.aws-access-key=REDACTED
hive.s3.aws-secret-key=REDACTED
hive.s3.path-style-access=true
hive.s3.ssl.enabled=false
@@ -0,0 +1,3 @@
connector.name=mongodb
mongodb.connection-url=mongodb://10.0.21.51:27017/
mongodb.schema-collection=__trino_schema
+4
View File
@@ -0,0 +1,4 @@
connector.name=mysql
connection-url=jdbc:mysql://10.0.21.51:3306
connection-user=mo
connection-password=REDACTED
@@ -0,0 +1,4 @@
connector.name=postgresql
connection-url=jdbc:postgresql://10.0.21.51:5432/postgres
connection-user=mo
connection-password=REDACTED