- Design, develop, test, deploy and maintain large-scale data pipelines using Python, Spark, SQL and AWS.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.
- Develop scalable data processing architectures to handle big data volumes and ensure data quality through testing and monitoring.
- Troubleshoot issues related to pipeline failures or performance problems.
Job Requirements :
- 3-5 years of experience in Data Engineering with expertise in Python programming language.
- Solid understanding of Spark for distributed computing tasks such as ETL processes.
- Proficiency in SQL for querying relational databases like MySQL or PostgreSQL.
- Experience working with cloud-based platforms like AWS for deploying applications.
📌 Data Engineer (Coimbatore)
🏢 ShyftLabs
📍 Coimbatore
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.