Skills Required6+ years(6 year) of qualified software engineering mostly focused on the following: Developing ETL pipelines involving big data.

Developing data processinganalytics applications primarily using PySpark.

Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.

Clear understanding and ability to implement distributed storage, processing and scalable applications.

Experience of working with SQL and NoSQL database.

Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.

Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries.ValidationStart Date ValidatedJob DescriptionWhat you’ll do

Develop low level design as per approved Tech Specification or equivalent inputs provided.





Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.

Build and delivery technology deliverables compliant with functional requirements.

Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc.

Process technology deliverables through full development lifecycle.

Maintain and support existing solutions and technology frameworks.

Attend regular scrum events of equivalent and provide update on the deliverables.

Work independently with none or minimum supervision.

Skills: aws,data engineer,pyspark

📌 AEP Data Engineer (Chennai)
🏢 Commergence
📍 Chennai