Lakehouse Admin
143 lines
4.0 KiB
YAML
143 lines
4.0 KiB
YAML
---
|
|
# Lakehouse Data Pipeline Dashboard
|
|
# Organized by system type with Palantir-style layout
|
|
|
|
- Data Pipeline:
|
|
- Kafka UI:
|
|
icon: mdi-apache-kafka
|
|
color: "#E02014"
|
|
href: http://atc-kafka01.dell-atc.lan:9000/
|
|
description: Kafka Topics & Management
|
|
- Debezium Connect:
|
|
icon: mdi-database-sync
|
|
color: "#4ECDC4"
|
|
href: http://atc-lake01.dell-atc.lan:8083/
|
|
description: CDC Connectors
|
|
- Spark Master:
|
|
icon: mdi-star-four-points
|
|
color: "#E25A1C"
|
|
href: http://atc-lake01.dell-atc.lan:8080/
|
|
description: Spark Jobs & Monitoring
|
|
- Trino:
|
|
icon: si-trino
|
|
color: "#DD00A1"
|
|
href: http://atc-lake01.dell-atc.lan:8089/
|
|
description: Distributed SQL Query Engine
|
|
|
|
- Source Systems:
|
|
- MongoDB:
|
|
icon: si-mongodb
|
|
color: "#47A248"
|
|
href: mongodb://atc-db02.dell-atc.lan:27017
|
|
description: MongoDB Supply Chain Data
|
|
- PostgreSQL:
|
|
icon: si-postgresql
|
|
color: "#4169E1"
|
|
href: postgresql://atc-db02.dell-atc.lan:5432
|
|
description: PostgreSQL Sales Data
|
|
- Cassandra:
|
|
icon: si-apachecassandra
|
|
color: "#1287B1"
|
|
href: cassandra://atc-db02.dell-atc.lan:9042
|
|
description: Cassandra Telemetry Data
|
|
- MySQL:
|
|
icon: si-mysql
|
|
color: "#4479A1"
|
|
href: mysql://atc-db02.dell-atc.lan:3306
|
|
description: MySQL HR Data
|
|
- Neo4j:
|
|
icon: si-neo4j
|
|
color: "#008CC1"
|
|
href: http://atc-db02.dell-atc.lan:7474/
|
|
description: Neo4j Graph Database
|
|
|
|
- Storage:
|
|
- ObjectScale S3:
|
|
icon: mdi-database-cloud
|
|
color: "#00d2ff"
|
|
href: http://10.0.20.111:9020/
|
|
description: S3 Object Storage
|
|
- ObjectScale Web:
|
|
icon: mdi-server-network
|
|
color: "#b500ff"
|
|
href: https://10.0.20.111/
|
|
description: ObjectScale Management UI
|
|
|
|
- Orchestration:
|
|
- Airflow:
|
|
icon: si-apacheairflow
|
|
color: "#017CEE"
|
|
href: http://10.0.21.55:8080/
|
|
description: Workflow Orchestration
|
|
|
|
- Analytics & Visualization:
|
|
- Superset:
|
|
icon: mdi-chart-bar
|
|
color: "#6c5ce7"
|
|
href: http://atc-docker01.dell-atc.lan:8088/
|
|
description: Business Intelligence & Dashboards
|
|
- Elasticsearch:
|
|
icon: si-elasticsearch
|
|
color: "#005571"
|
|
href: http://atc-elastic01.dell-atc.lan:9200/
|
|
description: Search & Analytics Engine
|
|
- Kibana:
|
|
icon: si-kibana
|
|
color: "#F04E98"
|
|
href: http://atc-elastic01.dell-atc.lan:5601/
|
|
description: Data Visualization
|
|
- Grafana:
|
|
icon: si-grafana
|
|
color: "#F46800"
|
|
href: http://atc-grafana.dell-atc.lan/
|
|
description: Metrics & Monitoring
|
|
|
|
- Management:
|
|
- Proxmox:
|
|
icon: si-proxmox
|
|
color: "#E57000"
|
|
href: https://dcp-pve01.dell-atc.lan:8006/
|
|
description: Virtualization Platform
|
|
- Git/Forgejo:
|
|
icon: si-git
|
|
color: "#F05032"
|
|
href: http://atc-mgt01.dell-atc.lan:3001/
|
|
description: Git Repository
|
|
- ATC LDAP:
|
|
icon: mdi-account-group
|
|
color: "#0984e3"
|
|
href: http://atc-mgt01.dell-atc.lan/lam/
|
|
description: LDAP Management
|
|
|
|
- Data Engineering & AI Resources:
|
|
- TLDR Data Engineering:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://tldr.tech/dataengineering/
|
|
description: Daily data engineering news
|
|
- TLDR AI:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://tldr.tech/ai/
|
|
description: Daily AI news
|
|
- KDnuggets:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://www.kdnuggets.com/
|
|
description: Data science and machine learning
|
|
- Towards Data Science:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://towardsdatascience.com/
|
|
description: Data science articles
|
|
- Data Engineering Central:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://www.dataengineeringcentral.com/
|
|
description: Data engineering resources
|
|
- Apache Airflow Blog:
|
|
icon: mdi-rss
|
|
color: "#f59e0b"
|
|
href: https://airflow.apache.org/blog/
|
|
description: Airflow updates and tutorials
|