Lakehouse Admin
118 lines
3.2 KiB
YAML
118 lines
3.2 KiB
YAML
---
|
|
# Lakehouse Data Pipeline Dashboard
|
|
# Organized by system type with colorful layout
|
|
|
|
- Data Pipeline:
|
|
- Kafka UI:
|
|
icon: si-apachekafka
|
|
href: http://10.0.21.36:9000/
|
|
description: Kafka Topics & Management
|
|
- Debezium Connect:
|
|
icon: si-apachedebezium
|
|
href: http://10.0.21.50:8083/
|
|
description: CDC Connectors
|
|
- Spark Master:
|
|
icon: si-apachespark
|
|
href: http://10.0.21.50:8080/
|
|
description: Spark Jobs & Monitoring
|
|
- Trino:
|
|
icon: si-trino
|
|
href: http://10.0.21.50:8089/
|
|
description: Distributed SQL Query Engine
|
|
|
|
- Source Systems:
|
|
- MongoDB:
|
|
icon: si-mongodb
|
|
href: mongodb://10.0.21.51:27017
|
|
description: MongoDB Supply Chain Data
|
|
- PostgreSQL:
|
|
icon: si-postgresql
|
|
href: postgresql://10.0.21.51:5432
|
|
description: PostgreSQL Sales Data
|
|
- Cassandra:
|
|
icon: si-apachecassandra
|
|
href: cassandra://10.0.21.51:9042
|
|
description: Cassandra Telemetry Data
|
|
- MySQL:
|
|
icon: si-mysql
|
|
href: mysql://10.0.21.51:3306
|
|
description: MySQL HR Data
|
|
- Neo4j:
|
|
icon: si-neo4j
|
|
href: http://10.0.21.51:7474/
|
|
description: Neo4j Graph Database
|
|
|
|
- Storage:
|
|
- ObjectScale S3:
|
|
icon: si-minio
|
|
href: http://10.0.20.111:9020/
|
|
description: S3 Object Storage
|
|
- ObjectScale Web:
|
|
icon: si-minio
|
|
href: https://10.0.20.111/
|
|
description: ObjectScale Management UI
|
|
|
|
- Orchestration:
|
|
- Airflow:
|
|
icon: si-apacheairflow
|
|
href: http://10.0.21.55:8080/
|
|
description: Workflow Orchestration
|
|
|
|
- Analytics & Visualization:
|
|
- Superset:
|
|
icon: si-apachesuperset
|
|
href: http://10.0.21.45:8088/
|
|
description: Business Intelligence & Dashboards
|
|
- Elasticsearch:
|
|
icon: si-elasticsearch
|
|
href: http://10.0.21.46:9200/
|
|
description: Search & Analytics Engine
|
|
- Kibana:
|
|
icon: si-kibana
|
|
href: http://10.0.21.46:5601/
|
|
description: Data Visualization
|
|
- Grafana:
|
|
icon: si-grafana
|
|
href: http://10.0.20.103/
|
|
description: Metrics & Monitoring
|
|
|
|
- Management:
|
|
- Proxmox:
|
|
icon: si-proxmox
|
|
href: http://10.0.10.65:8006/
|
|
description: Virtualization Platform
|
|
- Git/Forgejo:
|
|
icon: si-git
|
|
href: http://atc-mgt01.dell-atc.lan:3001/
|
|
description: Git Repository
|
|
- ATC LDAP:
|
|
icon: si-openldap
|
|
href: http://atc-mgt01.dell-atc.lan/lam/
|
|
description: LDAP Management
|
|
|
|
- Data Engineering & AI Resources:
|
|
- TLDR Data Engineering:
|
|
icon: si-rss
|
|
href: https://tldr.tech/dataengineering/
|
|
description: Daily data engineering news
|
|
- TLDR AI:
|
|
icon: si-rss
|
|
href: https://tldr.tech/ai/
|
|
description: Daily AI news
|
|
- KDnuggets:
|
|
icon: si-rss
|
|
href: https://www.kdnuggets.com/
|
|
description: Data science and machine learning
|
|
- Towards Data Science:
|
|
icon: si-rss
|
|
href: https://towardsdatascience.com/
|
|
description: Data science articles
|
|
- Data Engineering Central:
|
|
icon: si-rss
|
|
href: https://www.dataengineeringcentral.com/
|
|
description: Data engineering resources
|
|
- Apache Airflow Blog:
|
|
icon: si-rss
|
|
href: https://airflow.apache.org/blog/
|
|
description: Airflow updates and tutorials
|