m
muneeb_detech

Muneeb Ahmad

@muneeb_detech

Data Engineer

Pakistán
Inglés, Urdu
Parte de la información aparece en idioma inglés.
Sobre mí
Data Engineer specializing in building end-to-end, self-hosted data lakehouses on Kubernetes using open-source technologies. I designed and operated a full production-grade data platform implementing Bronze/Silver/Gold medallion architecture processing ~5 million rows across 5 cities. My stack: Apache Spark (batch), Apache Flink (streaming), Trino (federated SQL), dbt-Trino, Apache Iceberg, MinIO, Google BigQuery, Dagster, GitHub Actions, Grafana, and Apache Superset. I help businesses build scalable ETL pipelines, data lakehouses, dbt transformation models, and BI dashboards.... Lee más

Habilidades

m
muneeb_detech
Muneeb Ahmad
desconectado • 
Tiempo medio de respuesta: 1 hora

Revisa mis servicios

Almacén de datos
I will build a production grade apache spark etl data pipeline
DeUSD 500 / proyectoMás información

Porfolio

Experiencia laboral

GitHub

Data Engineer

GitHub • Freelance

Aug 2025 - Present • 10 mos

Designed and deployed a fully self-hosted, open-source data lakehouse on Kubernetes (k3s) implementing Bronze/Silver/Gold medallion architecture processing ~4.87M rows across 5 cities. - Built Spark + PyDeequ pipelines for Bronze/Silver ingestion, cleansing, and data quality - Developed dbt-trino Gold layer models: Data Vault, Star Schema, OBT, and Data Marts - Dual storage: MinIO/Iceberg (self-hosted) and Google BigQuery (cloud) - Orchestrated end-to-end pipelines with Dagster across two independent Docker code locations - Implemented CI/CD with GitHub Actions + Mage AI for automated builds and k3s deployments - Built observability stack: Prometheus, Grafana, Loki, and Marquez data lineage - Developed 8 BI dashboards in Apache Superset and configured n8n for Slack/email alerting - Managed full Kubernetes infrastructure: Helm deployments, resource tuning, and monitoring