Farhan Mughal

Freelance Data & Backend Engineer

Jun 2022 - Present • 4 yrs 1 mo

Worked on freelance projects involving data and backend system design, data processing and automation workflows. Built real-world backend systems including API development, real-time IoT data processing and batch data workflows. Designed rule-based systems to process structured inputs and trigger actions based on defined constraints, supporting automation use cases such as scheduling systems and input-driven workflows. Designed and implemented ETL/ELT pipelines across Data Lakes, Data Warehouses, and Lakehouse architectures to ingest, clean, validate and transform data into consistent, analysis-ready formats. Worked on API-based data ingestion, data modeling and structuring datasets for downstream analytical use. Focused on building scalable, maintainable data pipelines aligned with real-world operational and reporting needs.

Senior Data Engineer

Apr 2021 - Present • 5 yrs 3 mos

Working in a production AWS data engineering environment, responsible for architecting, designing, and implementing scalable data platforms and analytics pipelines. Key responsibilities include: • Building data ingestion pipelines from on-prem and external sources into an S3-based data lake • Organizing the lake into raw, curated and processed layers for scalable analytics • Developing ETL/ELT pipelines using AWS Glue and Spark on EMR • Loading datasets into Amazon Redshift, implementing fact and dimension models for BI • Optimizing Redshift performance through distribution keys, sort keys, and query tuning • Troubleshooting production ETL and data pipeline issues • Collaborating with analytics, backend, and DevOps teams to maintain reliable production data systems Working with high-volume datasets and performance-critical workloads in live environments.

Backend / IoT Developer

Dec 2018 - Apr 2021 • 2 yrs 4 mos

Worked as a Backend and IoT Developer, contributing to the development of data-driven backend systems and device-level integrations. Key responsibilities included: • Designing and developing backend services and APIs for IoT-based data workflows • Handling structured data ingestion and processing from connected devices • Implementing database schemas and optimizing SQL queries for performance • Supporting data transformation and storage workflows for analytics consumption • Collaborating with cross-functional teams to ensure reliable data flow between devices, backend systems, and reporting layers