Kashif S.

Data Engineer II

Careem • Tiempo completo

Aug 2021 - Sep 2022 • 1 yr 1 mo

Part of an agile DataOps team managing an AWS-based data platform at ride-hail scale, overseeing 500+ streaming and 700+ batch jobs running in production. • Built and maintained batch and streaming pipelines in Python and Spark; orchestrated with Apache Airflow and automated deploy- ments via Jenkins, improving pipeline reliability and reducing manual intervention. • Designed and shipped a self-serve data portal enabling technical users to schedule batch and streaming jobs (MySQL, PostgreSQL, SQL Server, DynamoDB) through a web interface — replacing multi-step CLI workflows and migrating service provisioning to Cloud- Formation. • Provisioned and managed AWS infrastructure via Terraform (IaC); implemented job monitoring and alerting with Grafana and VictorOps (Splunk OnCall) for proactive incident resolution.

Software Engineer

Telenor Group • Tiempo completo

Oct 2019 - Aug 2021 • 1 yr 10 mos

Part of the Data and BI team for Greenfield implementation of DaaS (Big Data Cloud Platform) for Pakistan's largest Digital Payment system. I'm responsible for writing and maintaining Apache Spark jobs to acquire mobile app relevant data from various sources like Appsflyer, Google Analytics, and Firebase Analytics, storing them in Hadoop based echo system, integrating them with financial systems to build dashboards that represent the 360-degree insights of products to product teams and higher management. Helping Marketing, Acquisition, Operations and Products team to build a better understanding of customer quality. Liaison person for Mobile App Data Provisioning to the regulatory authority (State Bank of Pakistan) to investigate fraudulent cases and other compliance requirements.