Experience: 5+ Years
Location: Hyderabad / Bangalore
Work Model: Hybrid
Job Summary
We are looking for an experienced Data Engineer to design, develop, and maintain scalable data pipelines for large-scale data processing. The ideal candidate should have solid expertise in PySpark, Apache Spark, Python, Scala, SQL, and contemporary data engineering frameworks. The role involves building high-performance ETL pipelines, optimizing distributed data processing, and collaborating with cross-functional teams to deliver reliable data solutions.
Key Responsibilities
Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
Develop and optimize PySpark applications for large-scale distributed data processing.
Build and maintain ETL/ELT pipelines using Apache Spark.
Write complex SQL queries for data extraction, transformation, and analysis.
Develop reusable data engineering components and automation frameworks.
Optimize Spark jobs for performance, scalability, and reliability.
Perform data validation, reconciliation, and quality checks.
Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver data solutions.
Troubleshoot production issues and provide ongoing support.
Maintain code repositories using Git and follow version control best practices.
Work in Linux settings for deployment, monitoring, and troubleshooting.
📌 Data Engineer Telangana
🏢 Innominds Software
📍 Telangana
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.