15 Nov
|
Careernet
|
Kochi
Key Skills: Apache Spark, Python, Databricks, Microsoft Azure, AWS, Distributed Data Processing, Data Pipelines, Data Integration, SQL, Apache Airflow
Roles & Responsibilities:
- Design, develop, and maintain batch and distributed data pipelines using Spark and Python.
- Build and manage data engineering solutions on Databricks and Azure or AWS.
- Transform and curate data from multiple sources into dependable, analytics-ready datasets.
- Improve pipeline reliability, scalability, and processing efficiency for growing data volumes.
- Partner with analytics and application teams to deliver data integrations that meet business requirements.
Skills Required:
- 6-14 years of relevant data engineering experience.
- Hands-on experience with Apache Spark and Python for data processing.
- Practical experience developing data solutions with Databricks.
- Experience with either Microsoft Azure or Amazon Web Services (AWS) data environments.
- Solid understanding of distributed data processing, scalable pipelines, and data integration patterns.
Good to Have:
- SQL and Apache Airflow experience.
Education:
- B.E. or B.Tech degree.
📌 Data Engineer (Kochi)
🏢 Careernet
📍 Kochi