d
divya_patel15

Divya Patel

@divya_patel15

Software Engineer Data Engineer

India
Inglés, Hindi
Parte de la información aparece en idioma inglés.
Sobre mí
I am a Software Engineer/ data engineer with experience in building multithreaded data pipelines and modern ELT stacks. I specialize in Java, Python, and Spark, with a focus on creating scalable, fault-tolerant systems using AWS and BigQuery to improve data throughput and processing efficiency.... Lee más

Habilidades

d
divya_patel15
Divya Patel
desconectado • 
Tiempo medio de respuesta: 1 hora

Revisa mis servicios

ETL de datos
I will make data engineering pipelines
DeUSD 100 / proyectoMás información

Experiencia laboral

Microsoft

Software Development Engineer

Microsoft • Tiempo completo

Oct 2025 - Present • 10 mos

• Configured and deployed a modern ELT stack (Airbyte, Prefect, dbt) to orchestrate data ingestion, transformation, and loading into Google BigQuery. • Developed an organization-wide finance and business data upload platform using Python and Angular that validates, formats, and standardizes reports before storing them in Amazon S3 and Google BigQuery.

Amazon

Software Engineer

Amazon • Tiempo completo

Dec 2024 - Oct 2025 • 10 mos

• Built a multithreaded data pipeline using Java and Apache Spark to enable parallel data flow, reducing latency by 70% and significantly improving throughput and efficiency while ensuring consistency, reliability, and fault tolerance across large-scale data processing. • Developed Git-integrated Databricks jobs using Python to stream data from Kafka into Delta tables, designing a transactional, fault-tolerant, and scalable data pipeline that ensured reliability, consistency, and error-free ingestion. • Worked on a payment processing project using SFTP, S3, and Databricks to reconcile all transactions by coordinating with banks, payment gateways, and internal databases, ensuring fault-free and reliable payment methods.