
Yasaswini
Azure Data Engineer
Habilidades

Revisa mis servicios

Experiencia laboral
Azure Data Engineer
Fresenius Medical Care • Tiempo completo
May 2021 - Aug 2026 • 5 yrs 3 mos
•Designed and developed end-to-end ETL/ELT pipelines using Azure Data Factory for data ingestion and orchestration. 03/2023 – Present •Developed Azure Databricks notebooks to implement business logic and build Bronze, Silver, and Gold layers using Spark SQL and PySpark. •Implemented incremental and scheduled data loads using Delta Lake for efficient and reliable processing. •Integrated Azure Key Vault to securely manage secrets, connection strings, and access credentials. •Created parameterized and reusable ADF pipelines, reducing manual effort by approximately 40%. •Monitored pipeline executions, troubleshot failures, performed data reprocessing, and maintained production data pipelines. •Applied PySpark-based schema validation and data quality checks across Bronze, Silver, and Gold layers following Medallion Architecture. •Optimized Delta Lake operations and Spark workloads, improving pipeline runtime by approximately 30%.