Job Description
Job Description – Data Engineer
nPosition-Data Engineer
nExperience-5 – 10 Years
n

nLOCATION: NEWZEALAND (IN OFFICE OPPORTUNITY)
n

nJob Summary
nWe are seeking an experienced Data Engineer with strong expertise in building scalable and high-performance data platforms. The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, PySpark, Scala, Databricks, Docker, and Advanced SQL , with a proven track record of developing and optimizing large-scale data pipelines and ETL processes.
n

nKey Responsibilities
nDesign, develop, and maintain scalable data pipelines and data processing frameworks.
nBuild and orchestrate ETL/ELT workflows using Apache Airflow .
nDevelop data engineering solutions using Apache Spark, PySpark, and Scala .
nLeverage Databricks for large-scale data processing, optimization, and analytics.
nWrite, optimize, and troubleshoot complex SQL queries involving:
nInner, Left, Right, and Full Joins
nSelf Joins
nCTEs and Subqueries
nWindow Functions
nQuery Performance Tuning
nDevelop, deploy,



and manage containerized applications using Docker .
nCollaborate with cross-functional teams to gather requirements and deliver robust data solutions.
nImplement data quality checks, monitoring, and performance tuning.
nEnsure data governance, security, and compliance standards are maintained.
nTroubleshoot and resolve production issues related to data pipelines and processing jobs.
n

nMandatory Skills
nApache Airflow – DAG creation, workflow orchestration, scheduling, and monitoring.
nApache Spark – Distributed data processing and performance optimization.
nPySpark – ETL development, transformations, and data engineering.
nScala Programming – Strong hands-on development experience with Spark/Scala applications.
nDatabricks – Notebooks, workflows, Delta Lake, and cluster management.
nAdvanced SQL
nStrong expertise in Joins (Inner, Outer, Left, Right, Full, Self)
n

nWindow Functions
nQuery

📌 Data Engineer (Vadodara)
🏢 Talentgigs
📍 Vadodara