02 Oct
|
Blackbuck Insights
|
Bengaluru
02 Oct
Blackbuck Insights
Bengaluru
Position Summary
The Data Engineer is responsible for designing, building, and optimizing scalable data pipelines, data integration solutions, and cloud-based data platforms that support enterprise analytics, reporting, and AI/ML initiatives.
This role serves as a technical expert in data engineering, ensuring reliable data ingestion, high-quality data assets, and productive data processing while collaborating closely with architects, analysts, and business stakeholders.
Key Responsibilities
Data Engineering & Development
• Design, develop, and maintain scalable and high-performance data pipelines.
• Build and optimize ETL/ELT processes to ingest, transform, and deliver data across enterprise platforms.
• Develop and maintain reusable data engineering frameworks and components.
• Implement data integration solutions for structured and unstructured data sources.
• Support modern cloud-based data platform initiatives.
• Data Ingestion & Pipeline Operations Develop and manage batch and real-time data ingestion pipelines.
• Monitor and optimize pipeline performance, reliability,
and scalability.
• Troubleshoot data processing issues and implement corrective actions.
• Automate data workflows and orchestration processes.
• Ensure timely and accurate data delivery to downstream consumers.
Data Quality & Governance
• Implement data validation, reconciliation, and quality controls.
• Support data governance standards, metadata management, and data lineage initiatives.
• Identify and resolve data quality issues and causes.
• Contribute to data observability and monitoring solutions.
• Ensure compliance with organizational data management standards.
• Meridian Platform Support & Implementation Support the implementation and enhancement of Meridian data solutions.
• Develop integrations and data pipelines supporting Meridian initiatives.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Ensure successful deplo
📌 Data Engineer (Bengaluru)
🏢 Blackbuck Insights
📍 Bengaluru