4 Commits

Author	SHA1	Message	Date
mo	79888dc617	feat(openmetadata): ingest Elasticsearch (search) + Airflow (pipelines) ... - ES: connect over https with verify_certs=false (self-signed CA); 16 indexes incl source_data - Airflow: ingest 8 DAGs as pipelines from SQLite metadata DB snapshot - es_run.py: standalone runner that pins the working ES TLS config - Command Center API now wired with ELASTIC_PASSWORD	2026-06-27 12:49:30 +02:00
mo	b7965f98f4	fix(openmetadata): ES ingestion - disable self-signed cert verification (boolean)	2026-06-27 12:38:45 +02:00
mo	b7dab19590	feat(openmetadata): ingest full stack - Trino all catalogs + Kafka, S3, Superset, ES ... Widen Trino ingestion to every catalog (postgres_sales/mysql_hr/mongodb/iceberg) and add messaging (Kafka), storage (S3 object store), dashboards (Superset) and search (Elasticsearch) service ingestion configs so OpenMetadata reflects the whole running platform. Secrets are injected at run time, not committed.	2026-06-27 12:25:51 +02:00
mo	c3cacc141d	feat(masking): mask_to_curated DAG + OpenMetadata lineage + versioned OM artifacts ... - deploy/airflow/mask_to_curated_dag.py: Trino-SQL masking (hash/redact/generalize) of PII from postgres/mysql sources into iceberg.curated_masked.* (verified: 14k+11k masked rows, all PII masked). - OM source->masked lineage edges created; curated tables cataloged. - Version OM compose + ingestion configs + om_api helper under deploy/openmetadata.	2026-06-27 03:13:16 +02:00