22 Aug
|
Acumont Solutions
|
Noida
22 Aug
Acumont Solutions
Noida
Job Description:We are seeking an experienced and motivated Data Engineers to join our growing team. The ideal candidate will have a minimum of 4 years of hands-on experience in data engineering, with a strong focus on Spark.
As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure, as well as leading a team of data engineers to deliver high-quality solutions
Experience Range:4 - 7 years
Educational Qualifications:-B.Tech/B.E in CS/IT/AIML
Job Responsibilities:
- Lead a team of data engineers in designing, building, and maintaining robust and scalable data pipelines and ELT/ ETL processes using Spark.
- Collaborate closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver effective solutions.
- Architect and optimise data storage and processing solutions for performance, reliability, and scalability.
- Design and implement data quality and data validation processes to ensure the accuracy and integrity of our data.
- Stay up-to-date with the latest industry trends and best practices in data engineering and big data technologies.
- Mentor and guide team members, providing technical leadership, code reviews and knowledge sharing.
- Participate in the full development lifecycle, from requirements gathering to deployment and monitoring.
- Troubleshoot and resolve data pipeline issues, performance bottlenecks, and other technical challenges.
- Develop and maintain documentation for data pipelines, processes, and procedures.
Skills Required:Apache Spark , Python , Java , AWS , ETL , BigQuery, Data Warehousing
Candidate Attributes:
- Strong expertise in Apache Spark for processing and analysing large datasets.
- Experience of working with EMR and Dataproc is a plus.
- Robust coding experience in programming languages: Python or Java.
- Solid understanding of distributed computing concepts and data partitioning techniques.
- Experi
📌 Senior Data Engineer (Noida)
🏢 Acumont Solutions
📍 Noida