03 Sep
|
Enterprise Minds
|
Pune
03 Sep
Enterprise Minds
Pune
Job Description
Data Engineer
n
Location: Pune
n
Experience: 5–9 Years
n
Employment Type: Full-Time
n
Job Summary
n
We are looking for an experienced Data Engineer to join our team in Pune. The ideal candidate will have strong hands-on experience in building, deploying, and automating scalable data pipelines and data solutions. You will work on end-to-end data ingestion, processing, data modeling, visualization, and dashboarding solutions while collaborating with global customers and cross-functional teams.
n
The role requires strong expertise in Databricks, Java, SQL, Spark/PySpark , data modeling, and cloud technologies, preferably Azure .
n
Key Responsibilities
n
n
- Design, develop, and implement scalable data pipelines and data solutions .
n
- Build end-to-end data ingestion, transformation, and processing pipelines .
n
- Deploy and automate data pipelines and dashboards for customer implementations.
n
- Develop and maintain data models, schemas, and data processing workflows .
n
- Work with distributed data processing technologies such as Apache Spark/PySpark .
n
- Develop solutions using Databricks for large-scale data processing.
n
- Build and optimize dashboards and data visualizations using Splunk, Grafana, Power BI, Tableau , or similar tools.
n
- Develop and maintain data-driven services using Java and SQL.
n
- Work with structured and semi-structured data formats including JSON, XML, and Avro .
n
- Deploy applications and data services using Docker and Kubernetes .
n
- Work with cloud platforms, preferably Microsoft Azure .
n
- Design and implement batch and streaming data solutions using technologies such as Kafka .
n
- Ensure data quality, monitoring, reliability, and performance of data pipelines.
n
- Collaborate with international, cross-functional teams to understand requirements and deliver customer-focused solutions.
n
- Take ownership of projects from solution design and development through deployment and client handover .
n
- Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement.
n
- Communicate effectively with customers, stakeholders, and internal technical teams.
n
n
Required Skills & Experience
n
n
- Bachelor's or Master's degree in Computer Science, Information Technology , or a related field.
n
- 5–9 years of experience in Data Engineering, data pipelines, or data solutions.
n
- Strong hands-on experience with Databricks .
n
- Strong programming experience in Java .
n
- Strong proficiency in SQL and data modeling.
n
- Hands-on experience with Apache Spark / PySpark .
n
- Experience with data visualization tools such as Splunk, Grafana, Prometheus, Power BI, or Tableau .
n
- Good knowledge of Splunk SPL is an advantage.
n
- Experience working with JSON, XML, Avro , or similar data schemas.
n
- Experience with Docker and Kubernetes .
n
- Experience with cloud services, preferably Microsoft Azure .
n
- Knowledge of Kafka or other streaming platforms is a plus.
n
- Understanding of data quality, monitoring, and validation .
n
- Robust analytical, problem-solving, and troubleshooting skills.
n
- Excellent communication skills in English .
n
n
Good to Have
n
n
- Experience working with real-time/streaming data pipelines.
n
- Knowledge of Kafka and event-driven architectures .
n
- Experience with data quality frameworks and monitoring solutions.
n
- Experience working in Agile/Scrum environments.
n
- Experience working with international customers or distributed teams.
n
n
Why Join Us?
n
n
- Work on innovative data intelligence and analytics solutions .
n
- Opportunity to work with global customers and multidisciplinary teams .
n
- Exposure to modern technologies including Databricks, Spark, Azure, Kafka, Docker, Kubernetes, and Splunk .
n
- Be part of an Agile environment focused on innovation, ownership, and continuous improvement.
n
n
n
n
Thanks,
n
Renuka
📌 Data Engineer (Pune)
🏢 Enterprise Minds
📍 Pune