--- # Lakehouse Data Pipeline Dashboard # Organized by system type with colorful layout - Data Pipeline: - Kafka UI: icon: si-apachekafka href: http://10.0.21.36:9000/ description: Kafka Topics & Management widget: type: ping url: http://10.0.21.36:9000 - Debezium Connect: icon: si-apachedebezium href: http://10.0.21.50:8083/ description: CDC Connectors widget: type: ping url: http://10.0.21.50:8083 - Spark Master: icon: si-apachespark href: http://10.0.21.50:8080/ description: Spark Jobs & Monitoring widget: type: ping url: http://10.0.21.50:8080 - Trino: icon: si-trino href: http://10.0.21.50:8089/ description: Distributed SQL Query Engine widget: type: ping url: http://10.0.21.50:8089 - Source Systems: - MongoDB: icon: si-mongodb href: mongodb://10.0.21.51:27017 description: MongoDB Supply Chain Data widget: type: ping url: http://10.0.21.51:27017 - PostgreSQL: icon: si-postgresql href: postgresql://10.0.21.51:5432 description: PostgreSQL Sales Data widget: type: ping url: http://10.0.21.51:5432 - Cassandra: icon: si-apachecassandra href: cassandra://10.0.21.51:9042 description: Cassandra Telemetry Data widget: type: ping url: http://10.0.21.51:9042 - MySQL: icon: si-mysql href: mysql://10.0.21.51:3306 description: MySQL HR Data widget: type: ping url: http://10.0.21.51:3306 - Neo4j: icon: si-neo4j href: http://10.0.21.51:7474/ description: Neo4j Graph Database widget: type: ping url: http://10.0.21.51:7474 - Storage: - ObjectScale S3: icon: si-minio href: http://10.0.20.111:9020/ description: S3 Object Storage widget: type: ping url: http://10.0.20.111:9020 - ObjectScale Web: icon: si-minio href: https://10.0.20.111/ description: ObjectScale Management UI widget: type: ping url: https://10.0.20.111 - Orchestration: - Airflow: icon: si-apacheairflow href: http://10.0.21.55:8080/ description: Workflow Orchestration widget: type: ping url: http://10.0.21.55:8080 - Analytics & Visualization: - Superset: icon: si-apachesuperset href: http://10.0.21.45:8088/ description: Business Intelligence & Dashboards widget: type: ping url: http://10.0.21.45:8088 - Elasticsearch: icon: si-elasticsearch href: http://10.0.21.46:9200/ description: Search & Analytics Engine widget: type: ping url: http://10.0.21.46:9200 - Kibana: icon: si-kibana href: http://10.0.21.46:5601/ description: Data Visualization widget: type: ping url: http://10.0.21.46:5601 - Grafana: icon: si-grafana href: http://10.0.20.103/ description: Metrics & Monitoring widget: type: ping url: http://10.0.20.103 - Management: - Proxmox: icon: si-proxmox href: http://10.0.10.65:8006/ description: Virtualization Platform widget: type: ping url: http://10.0.10.65:8006 - Git/Forgejo: icon: si-git href: http://atc-mgt01.dell-atc.lan:3001/ description: Git Repository widget: type: ping url: http://atc-mgt01.dell-atc.lan:3001 - ATC LDAP: icon: si-openldap href: http://atc-mgt01.dell-atc.lan/lam/ description: LDAP Management widget: type: ping url: http://atc-mgt01.dell-atc.lan/lam - Data Engineering & AI Resources: - TLDR Data Engineering: icon: si-rss href: https://tldr.tech/dataengineering/ description: Daily data engineering news - TLDR AI: icon: si-rss href: https://tldr.tech/ai/ description: Daily AI news - KDnuggets: icon: si-rss href: https://www.kdnuggets.com/ description: Data science and machine learning - Towards Data Science: icon: si-rss href: https://towardsdatascience.com/ description: Data science articles - Data Engineering Central: icon: si-rss href: https://www.dataengineeringcentral.com/ description: Data engineering resources - Apache Airflow Blog: icon: si-rss href: https://airflow.apache.org/blog/ description: Airflow updates and tutorials