j
jose_mcatpo

JoseM

@jose_mcatpo

Data Engineer

Perú
Español, Inglés, Portugués
Parte de la información aparece en idioma inglés.
Sobre mí
I am a Data Engineer with strong experience in Big Data technologies and scalable data processing. I specialize in building, optimizing, and maintaining ETL pipelines using Apache Spark and SQL in large-scale data environments. My experience includes: - Spark (performance tuning and optimization) - ETL pipeline development - SQL query optimization - Data processing for large datasets - Hadoop ecosystems I focus on delivering efficient, scalable, and reliable solutions that reduce processing time and improve performance.... Lee más

Habilidades

j
jose_mcatpo
JoseM
desconectado • 
Tiempo medio de respuesta: 1 hora

Revisa mis servicios

ETL de datos
I will build or optimize your data pipeline using spark and etl
DeUSD 25 / proyectoMás información

Experiencia laboral

Data Engineer

Telefonica Moviles España SA • Tiempo completo

Mar 2020 - Present • 6 yrs 2 mos

Started my career in the BI & Big Data area, focusing on data analysis and report development using Teradata. I worked extensively on writing complex SQL queries to support business reporting and decision-making. I was also involved in data ingestion processes, using tools like Hive and Sqoop to extract large-scale telecommunications data (CDRs) and load it into Teradata. Additionally, I handled data ingestion from multiple sources including relational databases and flat files. Over time, I expanded into Big Data development, building and maintaining ETL pipelines using Apache Spark, Hive, and NiFi. These pipelines integrated data from various sources and were designed for scalability and performance. I later took on leadership responsibilities, leading development teams and defining best practices for ETL development and data architecture. I contributed to the design of efficient data workflows and scalable processing solutions in production environments. Key highlights: - ETL pipeline development with Spark, Hive, and NiFi - Large-scale data ingestion (CDR processing) - SQL and Teradata optimization - Big Data architecture design - Technical leadership and team coordination

PERU

Data Science practitioner

PERU • Tiempo parcial

Feb 2019 - Dec 2019 • 10 mos

Create regression models using the R programming language to predict the prices of international bonds. Also use web scraping to extract data from websites.