Role Overview :

As a Senior Data Engineer based in Chennai, you will serve as a technical cornerstone for our data infrastructure, architecting scalable pipelines that transform raw information into actionable business intelligence.

You will collaborate closely with cross-functional teams, including data scientists, product managers, and business stakeholders, to bridge the gap between complex data architecture and strategic decision-making. Your work will directly influence the efficiency of our data ecosystem, ensuring that our internal and external customers receive high-fidelity, real-time insights that drive organizational growth and operational excellence.

Key Responsibilities :

- Design and implement robust end-to-end data pipelines using Python and PySpark to ensure seamless data flow across distributed systems.
- Develop sophisticated data models that organize complex datasets, enabling stakeholders to derive meaningful patterns and trends efficiently.
- Orchestrate large-scale data processing workflows on AWS using Glue and Databricks to optimize performance and reduce latency for end-users.




- Maintain high standards of data integrity and security by implementing rigorous validation checks and automated monitoring within the cloud environment.
- Partner with engineering and analytics teams to translate business requirements into technical specifications, ensuring alignment between data infrastructure and organizational goals.

Required Skillset :

- Demonstrated expertise in building and maintaining high-performance data architectures using Python, SQL, and PySpark within AWS cloud environments.
- Proven ability to design complex data models that support diverse analytical needs while ensuring scalability and ease of maintenance.
- Hands-on experience leveraging Databricks and AWS Glue to manage big data workloads and streamline ETL processes.
- Strong communication skills with the ability to articulate technical concepts to non-technical stakeholders and influence cross-functional project outcomes.
- A proactive mindset with the ability to thrive in a hybrid work environment, balancing independent problem-solving with cooperative team efforts.
- Candidates should possess 6 to 14 years of relevant experience in data engineering, preferably backed by a degree in Computer Science, Engineering, or a related quantitative field.

📌 Senior Data Engineer - Python/PySpark (India)
🏢 Careernet
📍 India