21 Aug
|
Elabs Infotech
|
India
21 Aug
Elabs Infotech
India
Job Description: Data Engineering Lead,
Exp: 12-15 -yrs
Primary skill : Data Architecture & Engineering
Secondary Skill:Data models , ETL/ELT process.
Position Summary
The Data Engineering Lead will be responsible for leading the design, development, and implementation of scalable data platforms and pipelines that support enterprise analytics, reporting, and AI/ML initiatives. This role will oversee data ingestion frameworks, data quality processes, pipeline architecture, and the successful implementation and adoption of Meridian data solutions. The ideal candidate will combine strong technical expertise with leadership skills to drive data engineering best practices across the organization.
Key Responsibilities
Data Architecture & Engineering
Lead the design and development of scalable, reliable, and high-performance data pipelines.
Establish and maintain enterprise data ingestion frameworks for structured and unstructured data sources.
Develop data models, ETL/ELT processes, and data integration solutions to support business requirements.
Drive cloud-based data engineering solutions and up-to-date data platform architecture.
Data Ingestion & Pipeline Management
Own end-to-end data ingestion strategies and implementations.
Design, optimize, and monitor batch and real-time data pipelines.
Ensure efficient data movement across source systems, data lakes, data warehouses, and downstream applications.
Implement automation and orchestration for data workflows.
Data Quality & Governance
Define and enforce data quality standards, validation rules, and monitoring processes.
Collaborate with data governance teams to ensure data accuracy, consistency, and compliance.
Establish processes for data lineage, metadata management, and issue resolution.
Continuously improve data reliability, observability, and operational excellence.
Meridian Implementation
Lead the implementation, integration, and ongoing optimization of Meridian solutions.
Partner with business and technology stakeholders to align Meridian capabilities with organizational objectives.
Ensure successful deployment, adoption, and support of Meridian data initiatives.
Drive best practices and provide technical guidance related to Meridian architecture and operations.
Leadership & Stakeholder Management
Lead and mentor a team of data engineers and technical contributors.
Collaborate with architects, analysts, business stakeholders, and cross-functional teams.
Provide technical leadership, code reviews, and architectural oversight.
Drive continuous improvement, innovation, and engineering excellence.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.
8+ years of experience in Data Engineering, with 3+ years in a technical leadership role.
Strong experience in designing and implementing large-scale data pipelines and ingestion frameworks.
Expertise in ETL/ELT processes, data warehousing, and data lake architectures.
Proficiency in SQL and programming languages such as Python, Scala, or Java.
Experience with cloud platforms such as Azure, AWS, or Google Cloud.
Strong understanding of data quality, data governance, and data observability practices.
Experience with workflow orchestration tools such as Airflow, ADF, or similar platforms.
Preferred Qualifications
Experience implementing and supporting Meridian solutions.
Knowledge of real-time streaming technologies such as Kafka, Spark Streaming, or similar.
Experience with modern data platforms such as Databricks, Snowflake, Synapse, or Fabric.
Familiarity with DevOps, CI/CD, Infrastructure as Code, and automated testing practices.
Relevant cloud or data engineering certifications.
Success Measures
Reliable and scalable data ingestion framework.
Improved data quality and reduced data defects.
High-performing and maintainable data pipelines.
Successful Meridian implementation and adoption.
Enhanced team productivity and engineering standards.
📌 Data Architect (India)
🏢 Elabs Infotech
📍 India