Job Title: Big Data Engineer (EL3)

Experience: 4+ Years
Employment Type: Full-Time

Job Summary

We are looking for a skilled Big Data Engineer with 4+ years of experience in designing, developing, and optimizing scalable big data solutions. The ideal candidate should have strong expertise in Scala, PySpark, AWS, and AWS Glue, with hands-on experience building high-performance data pipelines and data validation frameworks. The candidate will work closely with cross-functional teams to deliver scalable, high-quality data engineering solutions while leveraging AI-powered development tools to improve productivity.

Key Responsibilities
- Design, develop, and optimize highly scalable, rule-based data validation engines capable of validating data across multiple data pipelines.
- Build and maintain high-performance big data pipelines using Scala, PySpark, AWS, and AWS Glue.
- Develop clean, productive, and well-tested code while utilizing optimized data formats such as Parquet for high-performance storage and retrieval.
- Perform data validation, profiling,



and quality assessments to ensure consistency and accuracy across enterprise data systems.
- Leverage enterprise-approved AI coding assistants and code-generation tools to improve software development efficiency and automate repetitive tasks.
- Collaborate with business stakeholders and cross-functional engineering teams to translate business requirements into scalable technical solutions.
- Evaluate emerging big data technologies and AI-driven engineering practices to enhance platform capabilities.
- Participate in code reviews, testing, debugging, and performance tuning to ensure high-quality software delivery.
- Continuously optimize data processing performance, scalability, and reliability across distributed systems.

Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 4+ years of software engineering experience developing big data

📌 Big Data Engineer (Noida)
🏢 WebSenor InfoTech
📍 Noida