
Tuan Le
Senior Data Engineer, Data Science, AI ML Engineer
Habilidades

Revisa mis servicios

Porfolio
Experiencia laboral
Senior Data Engineer
Verizon
Jan 2018 - Dec 2022 • 4 yrs 11 mos
Built and maintain a Databricks lakehouse platform (Bronze/Silver/Gold on Unity Catalog) that brings 6 source systems into one governed data layer Moved SQL Server sources to change data capture (CDC) with Lakeflow, so tables update incrementally instead of through full reloads Built SCD Type 2 history tracking in the Silver layer and fixed a validity bug in it across several pipelines Built NetSuite REST API ingestion, including deletion tracking so removed records are flagged in Silver instead of left behind Added data quality guards: Silver loads stop when the source arrives empty or with changed columns, instead of loading bad data Set up CI/CD in Azure DevOps with Databricks Asset Bundles, deploying the same code to dev, QA and production Wrote contract tests that run in CI and catch broken configuration before a release, such as a deploy that would silently ship no resources Automated release steps in Bash: catalog and schema setup, permissions, job triggers and safe teardown