31 Aug
|
Enterprise Minds
|
Pune
31 Aug
Enterprise Minds
Pune
Job Type: Full-time
Data Engineer Location: Pune Experience: 5–9 Years Employment Type: Full-Time Job Summary We are looking for an experienced Data Engineer to join our team in Pune. The ideal candidate will have strong hands-on experience in building, deploying, and automating scalable data pipelines and data solutions. You will work on end-to-end data ingestion, processing, data modeling, visualization, and dashboarding solutions while collaborating with global customers and cross-functional teams. The role requires strong expertise in Databricks, Java, SQL, Spark/PySpark , data modeling, and cloud technologies, preferably Azure . Key Responsibilities Design, develop, and implement scalable data pipelines and data solutions . Build end-to-end data ingestion, transformation, and processing pipelines . Deploy and automate data pipelines and dashboards for customer implementations. Develop and maintain data models, schemas, and data processing workflows . Work with distributed data processing technologies such as Apache Spark/PySpark . Develop solutions using Databricks for large-scale data processing. Build and optimize dashboards and data visualizations using Splunk, Grafana, Power BI, Tableau , or similar tools. Develop and maintain data-driven services using Java and SQL. Work with structured and semi-structured data formats including JSON, XML, and Avro . Deploy applications and data services using Docker and Kubernetes . Work with cloud platforms, preferably Microsoft Azure . Design and implement batch and streaming data solutions using technologies such as Kafka . Ensure data quality, monitoring, reliability, and performance of data pipelines. Collaborate with international, cross-functional teams to understand requirements and deliver customer-focused solutions.
Take ownership of projects from solution design and development through deployment and client handover . Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement. Communicate effectively with customers, stakeholders, and internal technical teams. Required Skills & Experience ~ Bachelor's or Master's degree in Computer Science, Information Technology , or a related field. ~5–9 years of experience in Data Engineering, data pipelines, or data solutions. ~ Strong hands-on experience with Databricks . ~ Strong programming experience in Java . ~ Solid proficiency in SQL and data modeling. ~ Hands-on experience with Apache Spark / PySpark . ~ Experience with data visualization tools such as Splunk, Grafana, Prometheus, Power BI, or Tableau . ~ Good knowledge of Splunk SPL is an advantage. ~ Experience working with JSON, XML, Avro , or similar data schemas. ~ Experience with Docker and Kubernetes . ~ Experience with cloud services, preferably Microsoft Azure . ~ Knowledge of Kafka or other streaming platforms is a plus. ~ Understanding of data quality, monitoring, and validation . ~ Strong analytical, problem-solving, and troubleshooting skills. ~ Excellent communication skills in English . Valuable to Have Experience working with real-time/streaming data pipelines. Knowledge of Kafka and event-driven architectures . Experience with data quality frameworks and monitoring solutions. Experience working in Agile/Scrum environments. Experience working with international customers or distributed teams. Why Join Us? Work on innovative data intelligence and analytics solutions . Opportunity to work with global customers and multidisciplinary teams . Exposure to modern technologies including Databricks, Spark, Azure, Kafka, Docker, Kubernetes, and Splunk . Be part of an Agile environment focused on innovation, ownership, and continuous improvement. Thanks, Renuka
📌 Data Engineer-Big Data. Teletrabajo (Pune)
🏢 Enterprise Minds
📍 Pune