18 Aug
|
Innova solutinos
|
India
18 Aug
Innova solutinos
India
Develop and optimize scalable data pipelines using Databricks and Apache Spark.
Design and implement solutions for data integration, data processing, and data storage on Databricks.
Collaborate with data scientists and analysts to build end-to-end analytics solutions.
Build and maintain automated workflows, ensuring reliability and efficiency.
Design and manage ETL processes in Databricks.
Write optimized Spark SQL and PySpark code for data transformations.
Work with large datasets and ensure performance, scalability, and reliability of data pipelines.
Monitor and troubleshoot existing data pipelines and workflows.
Integrate Databricks with other tools and systems like AWS, Azure, or Google Cloud.
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
Education
UG: Any Graduate
📌 Pyspark Developer Pune (India)
🏢 Innova solutinos
📍 India