16 Nov
|
MyCareernet
|
Kochi
Company:IT Services Organization
Key Skills: Data Engineer, Databricks, Python, Pyspark, Spark
Roles and Responsibilities:
- Design, develop, and maintain data pipelines for batch and large-scale data processing.
- Build data engineering solutions using Python and Databricks.
- Integrate data from diverse sources and prepare dependable datasets for analytics and downstream applications.
- Improve pipeline reliability, data quality, and processing efficiency.
- Support data workloads on Azure or AWS and resolve issues across the data lifecycle.
Skills Required:
- 6 - 14 years of relevant data engineering experience.
- Professional experience in data engineering, with strong Python programming skills.
- Hands-on experience developing data solutions on Databricks.
- Experience building scalable data pipelines and processing large datasets.
- Ability to develop and troubleshoot data integrations and production data workflows.
Good to Have:
- Experience with Apache Spark and PySpark.
Education: B.E., B.Tech, or B.Tech-M.Tech dual degree.
📌 Data Engineer (Kochi)
🏢 MyCareernet
📍 Kochi