19 Nov
|
Edgematics Group
|
Gurugram
19 Nov
Edgematics Group
Gurugram
: Lead Data Engineer
Position: Lead Data Engineer
Experience: 8+ Years
Location: Gurugram
Role Overview
We are looking for an experienced Lead Data Engineer to drive the design, development, implementation, and delivery of enterprise-scale cloud data platforms. The ideal candidate will have strong expertise in Snowflake, Microsoft Azure Data Services, Data Warehousing, ETL/ELT frameworks, and modern data architecture.
The candidate will lead complex data engineering and transformation initiatives, provide technical leadership to engineering teams, and design scalable, secure, and high-performance data solutions that enable data-driven business decisions.
The role requires a combination of deep technical expertise, architectural thinking, team leadership, and strong stakeholder management skills.
Key Responsibilities1. Data Architecture and Engineering
- Design and implement scalable, robust, and secure enterprise data platforms using Snowflake and Microsoft Azure services.
- Lead the development of modern data architectures, including cloud data warehouses, data lakes, and lakehouse solutions.
- Define data engineering standards, architectural best practices, and reusable design patterns.
- Ensure data platforms meet performance, scalability, availability, and security requirements.
2. Snowflake and Azure Data Services
- Provide hands-on technical leadership in Snowflake development, architecture, optimization, and administration.
- Leverage Azure data services to build and manage end-to-end data pipelines and data integration solutions.
- Design and implement efficient ETL/ELT pipelines for structured and semi-structured data.
- Optimize Snowflake queries, compute resources, storage, and overall platform performance.
- Implement appropriate data security, governance, access controls, and monitoring mechanisms.
3.
Data Pipeline Development and Transformation
- Lead the design, development, testing, and deployment of complex data pipelines.
- Establish best practices for data ingestion, transformation, orchestration, and integration.
- Ensure data quality, consistency, reliability, and availability across enterprise systems.
- Troubleshoot complex data engineering issues and drive continuous improvement in pipeline performance.
4. Technical Leadership and Team Management
- Lead, mentor, and guide data engineers in technical design, development, code reviews, and problem-solving.
- Drive technical decision-making and ensure adherence to engineering standards.
- Collaborate with architects, business analysts, data scientists, and other cross-functional teams.
- Manage technical deliverables and support the successful execution of complex data initiatives.
5. Stakeholder Management and Delivery
- Work closely with business stakeholders and clients to understand requirements and translate them into technical solutions.
- Communicate technical concepts, architectural decisions, risks, and recommendations clearly to technical and non-technical audiences.
- Manage priorities, dependencies, and delivery timelines across distributed teams.
- Identify opportunities for automation, innovation, cost optimization, and process improvement.
Required Technical Skills
- Strong hands-on experience with Snowflake and cloud data warehousing.
- Extensive experience with Microsoft Azure Data Services and cloud-based data engineering solutions.
- Strong understanding of data warehousing concepts, dimensional modelling, data modelling, and modern data architecture.
- Expertise in ETL/ELT design, development, orchestration, and optimization.
- Experience designing and implementing complex data pipelines and data integration frameworks.
- Strong SQL skills and experience with performance tuning and query optimization.
- Knowledge of data governance, data quality, security, and access management.
- Experience with data engineering best practices, deployment processes, and production support.
Key Competencies
- Strong technical leadership and stakeholder management skills.
- Excellent written and verbal communication.
- Robust analytical, problem-solving, and decision-making abilities.
- Customer-focused approach with sound business acumen.
- Ability to influence and drive technical decisions.
- Experience working with cross-functional and geographically distributed teams.
- Self-motivated, innovative, and committed to continuous improvement.
Preferred Qualifications
- Experience delivering large-scale enterprise cloud data transformation projects.
- Exposure to modern data engineering practices, automation, and CI/CD.
- Experience with Agile delivery methodologies.
- Relevant cloud or Snowflake certifications would be an advantage.
Ideal Candidate Profile The ideal candidate is a hands-on technical leader who can combine deep expertise in Snowflake and Azure data platforms with strong architectural capabilities and team leadership. The candidate should be comfortable engaging with senior stakeholders, solving complex data challenges, and delivering reliable, scalable, and business-aligned data solutions.
📌 Lead Data Engineer (Gurugram)
🏢 Edgematics Group
📍 Gurugram