05 Sep
|
Innova Solutions
|
Bengaluru
05 Sep
Innova Solutions
Bengaluru
Dear Candidate,
Innova is hiring Data Engineers for one of its Big 4 client.
Job Description: Data Engineer
Experience: 4+ Years
Education: Bachelors/Masters Degree in CS/IT or related field
Interview Mode- Face to face
Key Responsibilities:
Data Ingestion & Pipeline Development: Design, build, and maintain scalable batch/
real-time data pipelines to onboard, clean, transform, and integrate complex data
sources into the Azure Cloud. Implement and manage the Medallion Architecture
(Bronze, Silver, Gold layers) using Azure Databricks and Delta tables.
Data Modeling & Aggregation: Combine multiple data sources to create optimized
aggregate tables, views, and data models for downstream reporting and analytics
applications. Automate data workflows and pipelines on weekly/monthly/ad-hoc
schedules to ensure seamless data delivery.
Collaboration & Optimization: Partner closely with data engineers and data scientists
across squads to feature-engineer tables and views that support advanced analytics
use cases. Continuously monitor,
troubleshoot, and optimize data pipelines for
performance, scalability, and cost-efficiency.
Best Practices & Governance: Act as an advocate for engineering best practices,
including code modularity, documentation, error handling, and data quality checks.
Required Qualifications & Skills
Experience: 4+ years of hands-on skilled experience in data warehousing, ETL/
ELT design, and building enterprise data pipelines.
Cloud & Big Data Stack: Strong expertise working with large volumes of data within
Microsoft Azure. Deep hands-on experience with Azure Databricks, Delta Tables, and
contemporary Azure components.
Programming & Querying: Advanced working knowledge of Python and PySpark for
data transformation and distributed computing. Expert-level SQL skills with robust
understanding of data warehousing concepts, database schemas, and data modeling
📌 Azure Data Engineer Bengaluru
🏢 Innova Solutions
📍 Bengaluru