12 Oct
|
NAZZTEC
|
Indore
? Hiring: Data Engineer | 5+ Years | Indore
We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and data platforms across cloud and big data ecosystems.
? Location: Indore
? Experience: 5+ Years
? Department: Data Engineering
? Employment Type: Full-Time
? Role Overview
The ideal candidate should have solid expertise in:
✅ Hadoop
✅ Apache Spark / PySpark
✅ Snowflake
✅ Advanced SQL
✅ Data Modeling
✅ Apache Airflow
✅ Cloud Data Platforms
✅ ETL / ELT Pipelines
✅ Data Warehousing
✅ Data Quality & Pipeline Optimization
? Key Responsibilities
• Design, develop and maintain scalable ETL/ELT data pipelines
• Work with large-scale distributed data processing systems including Hadoop and Apache Spark
• Develop and optimize pipelines using PySpark and Spark SQL
• Build, maintain and optimize Snowflake data warehouses
• Implement data models including Star Schema, Snowflake Schema and SCD Types 1, 2 & 3
• Design and manage workflow orchestration using Apache Airflow
• Work with cloud platforms such as AWS, Azure or GCP
• Optimize pipelines for performance, scalability, reliability and cost efficiency
• Implement data quality checks, validation, monitoring and error handling
• Work with structured and semi-structured data including JSON, Parquet, Avro, ORC and CSV
• Collaborate with Data Analysts, Data Scientists and business stakeholders
• Participate in data architecture decisions, documentation and code reviews
• Troubleshoot complex data pipeline issues and drive continuous improvement
? Mandatory / Core Technical Skills
Big Data & Hadoop
• Hadoop – HDFS, YARN, MapReduce
• Apache Spark
• PySpark
• Spark SQL
• Hive
• Kafka – working knowledge
• HBase – optional
Cloud – At Least One Required
• AWS – S3, Glue, EMR, Redshift, Lambda, Athena
• OR Azure – ADLS, Azure Data Factory, Synapse, Databricks
• OR GCP – GCS, BigQuery, Dataproc, Dataflow, Composer
Data Warehousing
• Sno
📌 Data Engineer (Indore)
🏢 NAZZTEC
📍 Indore