Job Roles & Responsibilities: -
Design, develop, and maintain data pipelines and assets on AWS.
Optimize and refactor legacy PySpark / Spark SQL code for performance and maintainability.
Implement unit testing / TDD to ensure robust, bug-free code.
Debug and resolve complex performance, concurrency, and logic issues.
Manage code versioning and repositories (Git, JFrog Artifactory).
Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormation) for scalable data solutions.
Job Skills & Requirements: -
7+ years hands-on experience in Python, PySpark, Boto3, and related frameworks/libraries.
Proven expertise in Spark SQL & PySpark optimization.
Robust knowledge of AWS architecture (S3, EC2, Lambda, Redshift, CloudFormation).
Experience in code refactorization for clean, maintainable solutions.
Familiarity with Git, JFrog Artifactory, and contemporary CI/CD practices.
Robust debugging and problem-solving skills.
Solid understanding of unit testing and TDD methodologies.
Required Skill Profession
Computer Occupations
📌 Aws – Data Engineer Pune (India)
🏢 Epergne Solutions
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.