m
manish7lucky

Manish D.

@manish7lucky

Data Enginner and Python Developer

India
Inglés, Hindi, Bengalí
Parte de la información aparece en idioma inglés.
Sobre mí
Data Engineer building automated, production-grade pipelines from ingestion to analytics-ready warehouses. Built: a 1B+ row batch pipeline (Airflow, S3, Snowpipe, dbt) and a real-time streaming pipeline (Kafka, PySpark, Databricks, Delta Lake) with anomaly detection. Stack: Python, SQL, Airflow, dbt, PostgreSQL, Snowflake, AWS, Docker, Kafka. I can build ETL pipelines, automate reporting/spreadsheet syncs, set up Airflow orchestration, design dbt models, or fix a broken pipeline. Currently pursuing BS Data Science at IIT Madras. Clean code, clear scope, no surprises.... Lee más

Habilidades

m
manish7lucky
Manish D.
desconectado • 

Porfolio

Experiencia laboral

Personal_portfolio project

Nyc Taxi Data Pipeline

Personal portfolio project • Trabajador autónomo

Jul 2026 - Present • 3 mos

end to end production style data pipeline that reduces ingestion speed by 40%