
Vadym S.
Data Engineer Python, SQL, AWS, Databricks ETL, APIs and Automation
Habilidades

Revisa mis servicios


Experiencia laboral
Data Engineer
Freelance • Tiempo completo
Jul 2021 - Present • 5 yrs 4 mos
Delivered data engineering projects for clients across hospitality, e-commerce, retail and marketing analytics, often as the sole or lead data engineer. Hospitality platform (3+ years) - Built POS and partner API integrations with daily incremental ingestion and Bronze/Silver/Gold data modeling on AWS (Lambda, EventBridge, API Gateway, S3, SNS, Glue) - Added retries, monitoring, alerting and secure secret handling (Secrets Manager, least-privilege IAM) - Built a schema validation process so source changes couldn't silently break downstream reports - Built a monthly data preparation and ML forecasting pipeline (XGBoost) for 4,500+ hotels, plus a 6–12 month revenue forecast - Designed n8n AI workflows generating structured recommendations for thousands of hotels in parallel - Built a self-service tool that generates Terraform pull requests for provisioning S3, SFTP, IAM and secrets Marketing analytics on Databricks - Modeled connector data into Silver and Gold SQL layers, optimized tables and built KPI dashboards and AI-powered Q&A over the data E-commerce analytics - Stabilized and rewrote failing Spark jobs orchestrated by Airflow; improved batch and streaming pipelines (Kafka, S3, Hive, Druid) - Built Silver/Gold layers for BI dashboards (Superset, QuickSight) ETL automation - Built dbt + Airbyte + Airflow pipelines into PostgreSQL and BigQuery with data quality checks and alerting, cutting failed runs by ~30–40% Other - Event-driven API ingestion to GCP Pub/Sub, Spark/Delta Lake optimization on Azure Databricks, sales forecasting data prep in ClickHouse, early-stage startup backend and data design