s
samiullahmalikk

Sami Ullah

@samiullahmalikk

Senior Data Engineer Airflow, Spark, AWS

Pakistán
Inglés, Urdu
Parte de la información aparece en idioma inglés.
Sobre mí
I’m a Senior Data Engineer with 4+ years of experience building production data pipelines. I design and run ETL/ELT workflows, real-time streaming systems, and financial market data ingestion across equities, forex, crypto, and commodities. My stack: Python, Airflow, Kafka, PyFlink, Spark, PostgreSQL, MongoDB, Redis, TimescaleDB, and AWS (S3, RDS, EC2, Lambda). I focus on pipelines that are reliable, monitored, and documented, so your team can run them after handover. Message me with your data source, destination, and volume, and I’ll tell you honestly whether I’m a good fit.... Lee más

Habilidades

s
samiullahmalikk
Sami Ullah
desconectado • 
Tiempo medio de respuesta: 1 hora

Revisa mis servicios

Consultoría de ingeniería de datos
I will build etl data pipelines with airflow, python and AWS

Experiencia laboral

TRADERWARE

Senior Data Engineer

TRADERWARE • Freelance

Dec 2024 - Present • 1 yr 11 mos

Own end-to-end data feeding and ingestion for a social trading network and an AI-powered trading analytics platform Build and maintain financial market data pipelines across equities, forex, crypto and commodities using Airflow, Kafka, PyFlink, Spark and Python Converted a batch pipeline to real time with Kafka and PyFlink, with Redis topic routing and TimescaleDB sinks Migrated PostgreSQL infrastructure to AWS RDS and pricing data pipelines to QuestDB Enterprise Migrated about 25 PostgreSQL tables between market data providers and migrated Airflow (CeleryExecutor) to AWS EC2 with Docker Compose Built a real-time pipeline monitoring dashboard with Prometheus and Grafana, and maintained 99% uptime across critical pipelines Stack: Python, Airflow, Kafka, PyFlink, Spark, PostgreSQL, MongoDB, Redis, TimescaleDB, AWS (S3, RDS, EC2, Lambda, Secrets Manager), Docker

Ehsaan_Technologies

Data Engineer

Ehsaan Technologies • Tiempo completo

Aug 2022 - Dec 2024 • 2 yrs 4 mos

- Built a real-time stock data pipeline using Kafka, PyFlink and QuestDB - Developed Airflow pipelines ingesting market data from the FMP API, including a PostgreSQL-to-MongoDB migration - Built Python and Playwright web scrapers for financial data websites - Worked with PostgreSQL, MongoDB and Docker in production environments