Document lakehouse Debezium connectors and updated docker inventory.

Add atc-lake01 compose with s3-kafka-consumer; redact DB passwords in connector JSON.
This commit is contained in:
mo
2026-06-04 02:27:23 +02:00
parent 8f2bb06348
commit 8eb64381e3
6 changed files with 136 additions and 2 deletions
+13
View File
@@ -0,0 +1,13 @@
# Debezium connector definitions
Register on **atc-lake01** via `POST http://10.0.21.50:8083/connectors` with JSON body `{ "name": "...", "config": { ... } }`.
Passwords use `${DEBEZIUM_DB_PASSWORD}` — set on the host, not in git.
| Connector | Source DB | Topic prefix |
|-----------|-----------|--------------|
| postgres-sales-connector | postgres @ 10.0.21.51 `public.sales_orders` | postgres_sales |
| mysql-hr-connector | mysql hr.employee_events | mysql_hr |
| mongodb-supplychain-connector | mongodb supplychain.events | mongodb_supplychain |
Cassandra CDC skipped (requires table CDC + agent).