Job Description
Position: Data Engineer
n

nLocation: Pune/Nagpur
n

nType of Employment: FTE
n

nPurpose of the Position:
nThis position requires a sound knowledge on Big Data using Cloud technologies such as such as Databricks, EMR, Athena, PySpark, S3, AWS Lambda, Databricks, Snowflake etc. Strong foundation on database concepts and SQL is also required.
n

nKey Result Areas and Activities:
n
- n
- Technology Assessment and Designn

nStudy existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
n
- n
- Documentation and Stakeholder Communicationn

nProject documentation adheres to quality guidelines & schedules.
nWorks hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
n
- n
- Process Improvement and Automationn

nSuggests automation to improve existing processes.
nAssist junior Data Engineers by providing expert advice or troubleshooting steps whenever required.
n
- n
- Training and Knowledge Sharingn





nCreate technology-focused training plans whenever required.
nDeliver technology-focused training sessions with team members whenever required.
n

nEssential Skills:
n
- n
- In-depth knowledge of the following AWS services: S3, EC2, EMR, Athena, AWS Glue, Lambdan
- Experience with at least one MPP database: AWS Redshift, Snowflake, SingleStoren
- Proficiency in Big Data technologies: Apache Spark, Databricksn
- Must have robust programming skills in Pythonn
- Responsible for building data pipelines in AWS And Databricksn
- Experience with Big Data table formats, such as Delta Lake (open source)n
- Must have very strong SQL skillsn
- Experience with orchestration tools like Apache Airflown
- Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.n
- Should be a quick and self-learner, ready to adapt to new AWS services or Bi

📌 Senior Data Engineer-AWS (Pune)
🏢 InfoCepts
📍 Pune