Key Responsibilities

 Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark.

 Implement data models and schemas for efficient querying.

 Develop and optimize code in Scala and Java for data processing tasks.

 Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability.

 Collaborate with cross-functional teams to ensure seamless data integration and flow across systems.

 Stay up-to-date with industry trends and best practices in data engineering and big data technologies.

Required Skills

 1-3 years of experience in data engineering space.

 Proficiency in Kafka, Airflow, Spark, Scala, SQL, and Java.

 Experience in designing and managing data pipelines in a distributed environment.

 Solid understanding of ELT/ETL, datalake processes.

 Familiarity with AWS services is a plus.

 Strong problem-solving skills and ability to work in a rapid-paced environment.

📌 Senior Software Engineer - Data Engineer (Noida)
🏢 Info Edge
📍 Noida