07 Nov
|
Epergne Solutions
|
India
07 Nov
Epergne Solutions
India
Role : Senior AWS Data Engineer
Job Mode : Remote
Experience : 7+ Years
Notice Period : Immediate / 10 Days To 15 days NP
Job Description
We are looking for a Senior AWS Data Engineer with robust expertise in building scalable data pipelines and designing efficient data architectures.
The ideal candidate should have a solid background in data engineering, robust programming skills, and deep experience working with AWS cloud services.
Key Responsibilities
Design, develop, and maintain data pipelines and data assets using modern data engineering techniques.
Work extensively with PySpark, Python, and Boto3 to implement robust data solutions.
Optimize and refactor existing codebases to improve performance, readability, and maintainability.
Write and maintain unit tests following TDD principles to ensure code quality and functionality.
Debug and fix complex issues related to performance, concurrency, and logic.
Manage code versioning and collaboration using Git repositories and JFrog Artifactory.
Collaborate with cross-functional teams to design and implement AWS-based architectures.
Required Skills & Experience
7+ years of hands-on experience in data engineering.
Strong programming skills in Python, including frameworks and libraries aligned with Python best practices.
Proven experience with PySpark and Spark SQL for large-scale data processing and code optimization.
Proficient in AWS services such as S3, EC2, Lambda, Redshift, CloudFormation, etc., and able to explain their benefits and use cases.
Solid understanding of Git version control and artifact management tools (e.g., JFrog Artifactory).
Experience in code refactoring, unit testing, and debugging complex systems.
Preferred Qualifications
Experience in designing data lake or data warehouse architectures on AWS.
Exposure to DevOps and CI/CD pipelines for data workflows.
Robust analytical and problem-solving skills with a focus on performance tuning.
📌 Senior Aws Data Engineer Bengaluru (India)
🏢 Epergne Solutions
📍 India