We are looking for an experienced Python Data Engineer with strong expertise in PySpark/Spark SQL, AWS cloud services, ETL/ELT pipelines, and serverless data architectures. The ideal candidate will have hands-on experience building scalable data pipelines, designing robust data models, and developing cloud-native data solutions on AWS. The role requires close collaboration with data scientists, analysts, and business stakeholders to deliver high-quality, reliable data platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, and Spark SQL.
- Build and optimize ETL/ELT workflows for structured and semi-structured data.
- Develop cloud-native data solutions using AWS data services.
- Design and implement serverless architectures leveraging AWS services.
- Create and maintain effective data models to support reporting, analytics, and downstream applications.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Ensure data quality, reliability, and governance across data pipelines.
- Develop reusable, modular, and well-documented code following software engineering best practices.
- Write unit and integration tests using pytest or unittest.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Participate in code reviews, CI/CD implementation, and production suppo
📌 Excellent Opportunity For Python Data Engineer (Bengaluru)
🏢 Nous Infosystems
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.