07 Aug
|
Nous Infosystems
|
Bengaluru
07 Aug
Nous Infosystems
Bengaluru
We are looking for an experienced Python Data Engineer with solid expertise in PySpark/Spark SQL, AWS cloud services, ETL/ELT pipelines, and serverless data architectures. The ideal candidate will have hands-on experience building scalable data pipelines, designing robust data models, and developing cloud-native data solutions on AWS. The role requires close collaboration with data scientists, analysts, and business stakeholders to deliver high-quality, reliable data platforms.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Python, PySpark, and Spark SQL.
Build and optimize ETL/ELT workflows for structured and semi-structured data.
Develop cloud-native data solutions using AWS data services.
Design and implement serverless architectures leveraging AWS services.
Create and maintain effective data models to support reporting, analytics, and downstream applications.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Ensure data quality, reliability, and governance across data pipelines.
Develop reusable, modular, and well-documented code following software engineering best practices.
Write unit and integration tests using pytest or unittest.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Participate in code reviews, CI/CD implementation, and production suppo
📌 Excellent Opportunity For Python Data Engineer Bengaluru
🏢 Nous Infosystems
📍 Bengaluru