Role & responsibilities

Key Responsibilities

- Design, develop, and maintain scalable and optimized ETL/ELT data pipelines

- Build and enhance data processing solutions using Databricks, PySpark, Python, and SQL

- Work on integration of multiple source systems with varying data throughput and complexity

- Perform code optimization, performance tuning, and troubleshooting of data workflows

- Collaborate with cross-functional teams including business analysts, architects, QA, and reporting teams

- Ensure data quality, integrity, governance, and compliance standards are maintained

- Participate in code reviews, release planning, deployment activities, and production support

- Create and maintain technical documentation, design artifacts, and operational runbooks

- Identify risks proactively and propose mitigation approaches

- Support continuous improvement initiatives and adoption of best engineering practices

Mandatory Skills

- Strong hands-on experience in:

- Databricks

- PySpark

- Python

- SQL

- Git/version control

- Experience working on projects involving multiple integration systems and high-volume data processing

- Strong expertise in code optimization and performance tuning

- Experience in building scalable data engineering solutions and reusable frameworks

- Minimum 2+ years of experience delivering one or more end-to-end data engineering projects

Good to Have Skills

- Data Modelling

- Dimensional Modelling

- Schema Design

- Experience with reporting/visualization tools such as Microsoft Power BI

- Exposure to cloud platforms such as AWS, Azure,



or GCP

- Understanding of CI/CD pipelines and DevOps practices

- Experience working in Agile/Scrum delivery environments

- Experience in DLT (Delta Live Tables)

Soft Skills

- Robust attention to detail to ensure data accuracy and integrity

- Excellent communication and comprehension skills

- Clear and structured documentation practices

- Flexibility and adaptability to changing project environments and priorities

- Strong planning and prioritization skills with ability to meet timelines

- Ability to proactively identify risks and provide mitigation approaches

- Positive conflict resolution and stakeholder collaboration skills

- Ownership mindset with proactive and independent execution capabilities

- Positive attitude with strong problem-solving approach

Experience Guidelines

- Senior Developer Data Engineer

- 36 years of relevant experience

- Strong architecture understanding and optimization skills

- Ability to mentor junior team members and drive delivery ownership

Preferred Qualifications

- Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or related field

- Relevant Databricks or cloud certifications are an added advantage

Preferred candidate profile

Experience Guidelines

- Senior Developer Data Engineer

- 36 years of relevant experience

- Strong architecture understanding and optimization skills

- Ability to mentor junior team members and drive delivery ownership

Perks and benefits

- Hybrid Work

- Great working Culture

📌 Data Engineer (Pune)
🏢 Accion Labs
📍 Pune