mo
b7dab19590
Widen Trino ingestion to every catalog (postgres_sales/mysql_hr/mongodb/iceberg) and add messaging (Kafka), storage (S3 object store), dashboards (Superset) and search (Elasticsearch) service ingestion configs so OpenMetadata reflects the whole running platform. Secrets are injected at run time, not committed.
25 lines
532 B
YAML
25 lines
532 B
YAML
source:
|
|
type: kafka
|
|
serviceName: atc_kafka
|
|
serviceConnection:
|
|
config:
|
|
type: Kafka
|
|
bootstrapServers: 10.0.21.36:9092
|
|
sourceConfig:
|
|
config:
|
|
type: MessagingMetadata
|
|
generateSampleData: false
|
|
topicFilterPattern:
|
|
excludes:
|
|
- "^__.*"
|
|
- "^_confluent.*"
|
|
sink:
|
|
type: metadata-rest
|
|
config: {}
|
|
workflowConfig:
|
|
openMetadataServerConfig:
|
|
hostPort: http://openmetadata-server:8585/api
|
|
authProvider: openmetadata
|
|
securityConfig:
|
|
jwtToken: "__JWT__"
|