Role and Responsibilities

The Big Data Engineer will be part of a Data Engg & Analytics Project responsible to develop data applications using selected tools and frameworks as required and requested for project.

Candidate should be able to collect and process raw data at scale for a variety of systems and also be able to ETL activities using identified tools and frameworks as required.

Candidate will be responsible to perform tasks such as writing scripts, calling APIs, write SQL queries etc.

Candidate will be responsible for independently working on individual task assigned to him/her with defined timelines.

Ensuring products/services owned by the candidate is successfully deployed during the Deployment window.

Familiar with working on Agile framework and it's methodologies like Scrum, Kanban, XP etc.

Candidate should have excellent communication skills & a can do attitude towards work.

Should be proactive enough to highlight any challenges or impediments to address it on priority basis during regular Standup meetings.

Technical Competency

6-9 years of experience in data engineering.

Experience of working closely with Client team.

Excellent hold on design, building & deployment of Data Engg. products on On-Premise/Cloud Infrastructure.





Experience with private and public cloud architectures, pros/cons, and migration considerations

Experience implementing data pipelines using latest technologies and techniques.

5+ years of hands on experience in programming languages such as Scala, Python, Java, Unix shell/Python scripting etc.

Experience handling Structured and unstructured datasets.

Expert in SQL & No SQL databased, Hive SQL, Spark SQL, Data Bricks.

Technical expertise with data models, data mining, and segmentation techniques

Experience in Data Modelling and Advanced SQL techniques

Experience in building data systems and pipelines

Experience in building algorithms and prototype

Excellent problem solving, analytical, and critical thinking skills

Proficient with CI/CD, configuration & release management tools like CloudFormation, EMR on EC2, Lambda, S3, Glue, Athena, IAM, CloudWatch, Github, Jira etc.

Provide an efficient interface with various teams and provide appropriate technical support to all teams working on various platforms.

Self motivated and able to work in a fast paced environment.

BS in Computer Science or related field, or equivalent experience plus real passion to learn current technologies.

📌 Bigdata Engineer (Pune)
🏢 QuessCorp/Volkswagen
📍 Pune