Description
We are recruiting for an Associate Consultant in the team.
Your responsibilities will include:
- Design, develop, and maintain scalable data pipelines and data engineering solutions using Databricks, PySpark, Python, and Advanced SQL to support business reporting and analytics needs.
- Build and optimize ETL/ELT processes for ingesting, transforming, and processing structured and semi-structured data while ensuring data quality and reliability.
- Develop and maintain robust data models and curated datasets aligned with business and analytical requirements.
- Design and implement scalable, secure, and cost-effective data architectures on AWS and Azure, leveraging cloud-native services, Databricks, and Microsoft Fabric to support enterprise analytics and reporting requirements.
- Work closely with business stakeholders to understand requirements, ask appropriate business questions, and translate them into effective technical solutions.
- Perform data validation, testing, monitoring, and troubleshooting to ensure accuracy, performance, scalability,
and data integrity across pipelines.
- Leverage Databricks best practices to optimize Spark jobs, SQL workloads, and overall platform performance.
- Collaborate with cross-functional teams including analysts, architects, and business users to deliver high-quality data solutions and support data-driven decision making.
- Ensure all solutions adhere to organizational standards, security guidelines, governance policies, and development best practices
>> SKILLS & QUALIFICATIONS:
To succeed in this demanding role you will need to demonstrate the following skills and experience:
- Over 2 years of hands-on experience in Data Engineering, DataWarehousing, and large-scale data processing projects.
- Robust expertise in Databricks/ MS Fabric, Advanced SQL,Python, PySpark, Data Pipeline Development, and DataModeling. Power BI experience will be a plus.
- Experience in designing and developing scalable ETL/ELTpipelines an
📌 Associate Consultant (Gurugram)
🏢 BSR
📍 Gurugram