08 Aug
|
Moolya Software Testing
|
Bengaluru
08 Aug
Moolya Software Testing
Bengaluru
Job Title: Senior Data Engineer (Spark | SQL | Airflow)
Experience: 5+ Years
Location: Bangalore
Work Mode: Work from Office (WFO)
About the Role
We are looking for a highly skilled Senior Data Engineer with strong expertise in SQL, Apache Spark, and Apache Airflow to build and optimize scalable data pipelines. The ideal candidate should have hands-on experience working with large datasets, designing effective ETL/ELT workflows, and ensuring reliable data delivery for analytics and business intelligence.
Key Responsibilities
Design, build, and optimize large-scale ETL/ELT pipelines using Apache Spark.
Develop, optimize, and maintain complex SQL queries for processing large volumes of data.
Build, schedule, and monitor data pipelines using Apache Airflow.
Collaborate with Data Science, Analytics, and Engineering teams to ensure high-quality and reliable data.
Implement best practices for data engineering, performance optimization, and pipeline reliability.
Work with structured and semi-structured data to support business reporting and analytics.
Required Skills & Qualifications
5+ years of experience in Data Engineering.
Solid expertise in SQL (Primary evaluation area).
Complex SQL queries
Query optimization
Joins, CTEs, Window Functions
Performance tuning
Hands-on experience with Apache Spark.
Distributed data processing
Spark DataFrame APIs
Performance optimization
Experience with Apache Airflow for workflow orchestration and scheduling.
Solid understanding of Data Modeling and Data Warehousing concepts.
Excellent problem-solving and analytical skills.
Good to Have
Experience with cloud platforms (AWS, GCP, or Azure).
Proficiency in Python.
Experience with Delta Lake and Parquet.
Interview Focus
The technical evaluation will primarily focus on SQL proficiency, including:
Complex query writing
Query optimization
Window functions
Joins and CTEs
Performance tuning
Candidates should also demonstrate practical knowledge of Apache Spark and Apache Airflow through hands-on problem-solving and technical discussions.
📌 Senior Data Engineer Bengaluru
🏢 Moolya Software Testing
📍 Bengaluru