Job Description
Position: Data Engineer
n

nLocation: Pune/Nagpur
n

nType of Employment: FTE
n

nPurpose of the Position:
nThis position requires a sound knowledge on Big Data using Cloud technologies such as such as Databricks, EMR, Athena, PySpark, S3, AWS Lambda, Databricks, Snowflake etc. Solid foundation on database concepts and SQL is also required.
n

nKey Result Areas and Activities:
n
n
Technology Assessment and Designn

nStudy existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
n
n
Documentation and Stakeholder Communicationn

nProject documentation adheres to quality guidelines & schedules.
nWorks hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
n
n
Process Improvement and Automationn

nSuggests automation to improve existing processes.
nAssist junior Data Engineers by providing expert advice or troubleshooting steps whenever required.
n
n




Training and Knowledge Sharingn

nCreate technology-focused training plans whenever required.
nDeliver technology-focused training sessions with team members whenever required.
n

nEssential Skills:
n
n
In-depth knowledge of the following AWS services: S3, EC2, EMR, Athena, AWS Glue, Lambdan
Experience with at least one MPP database: AWS Redshift, Snowflake, SingleStoren
Proficiency in Big Data technologies: Apache Spark, Databricksn
Must have robust programming skills in Pythonn
Responsible for building data pipelines in AWS And Databricksn
Experience with Big Data table formats, such as Delta Lake (open source)n
Must have very robust SQL skillsn
Experience with orchestration tools like Apache Airflown
Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.n
Should be a quick and self-learner, ready to adapt to new AWS services or Bi

📌 Senior Data Engineer Aws Pune
🏢 InfoCepts
📍 Pune