Position:
Data Engineer

Location:
Pune/Nagpur

Type of Employment:
FTE

Purpose of the Position:

This position requires a sound knowledge on Big Data using Cloud technologies such as such as Databricks, EMR, Athena, PySpark, S3, AWS Lambda, Databricks, Snowflake etc. Strong foundation on database concepts and SQL is also required.

Key Result Areas and Activities:
- Technology Assessment and Design

Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
- Documentation and Stakeholder Communication

Project documentation adheres to quality guidelines & schedules.

Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
- Process Improvement and Automation

Suggests automation to improve existing processes.

Assist junior Data Engineers by providing expert advice or troubleshooting steps whenever required.
- Training and Knowledge Sharing

Create technology-focused training plans whenever required.





Deliver technology-focused training sessions with team members whenever required.

Essential Skills:
- In-depth knowledge of the following AWS services: S3, EC2, EMR, Athena, AWS Glue, Lambda
- Experience with at least one MPP database: AWS Redshift, Snowflake, SingleStore
- Proficiency in Big Data technologies: Apache Spark, Databricks
- Must have strong programming skills in Python
- Responsible for building data pipelines in AWS And Databricks
- Experience with Big Data table formats, such as Delta Lake (open source)
- Must have very strong SQL skills
- Experience with orchestration tools like Apache Airflow
- Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.
- Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required
- Strong Understanding with Media domain
- Solid understanding of data warehousing con

📌 Senior Data Engineer-AWS (Pune City)
🏢 InfoCepts
📍 Pune City