16 Nov
|
MyCareernet
|
Kochi
Company:IT Services Organization
Key Skills: AWS, Microsoft Azure, Apache Spark, Python, Databricks, Distributed Data Processing, Data Pipelines, PySpark
Roles & Responsibilities:
- Design and develop data pipelines for large-scale batch and distributed data processing.
- Build and maintain data engineering solutions using Apache Spark, Python, and Databricks.
- Integrate data from multiple sources and deliver well-structured datasets for downstream use.
- Develop cloud-based data solutions on AWS or Microsoft Azure.
- Improve the reliability and efficiency of data processing workflows and troubleshoot production issues.
Skills Required:
- 6-14 years of relevant data engineering experience.
- Hands-on experience with AWS or Microsoft Azure cloud services.
- Strong experience building distributed data-processing solutions with Apache Spark and Databricks.
- Proficiency in Python for data engineering and pipeline development.
- Experience developing and supporting scalable data pipelines in a cloud setting.
Good to Have:
- PySpark experience.
Education:
- Bachelor's or master's degree; B.Tech, B.E, and M.Tech are suitable qualifications.
📌 Big Data Engineer (Kochi)
🏢 MyCareernet
📍 Kochi