16 Nov
|
MyCareernet
|
Kochi
Company:IT Services Organization Key
Skills:
AWS, Microsoft Azure, Apache Spark, Python, Databricks, Distributed Data Processing, Data Pipelines, PySpark Roles &
Responsibilities:
• Design and develop data pipelines for large-scale batch and distributed data processing.
• Build and maintain data engineering solutions using Apache Spark, Python, and Databricks.
• Integrate data from multiple sources and deliver well-structured datasets for downstream use.
• Develop cloud-based data solutions on AWS or Microsoft Azure.
• Improve the reliability and efficiency of data processing workflows and troubleshoot production issues. Skills Required:
• 6-14 years of relevant data engineering experience.
• Hands-on experience with AWS or Microsoft Azure cloud services.
• Strong experience building distributed data-processing solutions with Apache Spark and Databricks.
• Proficiency in Python for data engineering and pipeline development.
• Experience developing and supporting scalable data pipelines in a cloud setting. Good to Have:
• PySpark experience.
Education:
• Bachelor's or master's degree; B.
Tech, B.
E, and M.
Tech are suitable qualifications.
📌 Big Data Engineer_105827 (Kochi)
🏢 MyCareernet
📍 Kochi