02 Nov
|
MyCareernet
|
Bengaluru
02 Nov
MyCareernet
Bengaluru
Company:A Large Global Organization Key
Skills:
Pyspark, Azure Databricks, SQL, Medallion Architecture, PowerBI, Python Roles and
Responsibilities:
• Design, build, and maintain scalable ETL and ELT pipelines using Azure Databricks and PySpark.
• Ingest and transform structured, semi-structured, and unstructured data from enterprise source systems.
• Develop curated Delta Lake data models across medallion architecture layers for analytics and AI/ML consumption.
• Implement data quality controls, operational metadata, auditability, lineage, reconciliation, and exception handling.
• Support governed access to lakehouse data and resolve pipeline, data quality, and delivery issues in collaboration with downstream consumers. Skills Required:
• 5
- 8 years of relevant experience in data engineering and lakehouse development.
• Hands-on experience developing production data pipelines with PySpark and Azure Databricks.
• Strong SQL skills for data transformation, validation, analysis, and performance tuning.
• Practical experience implementing medallion architecture and curated lakehouse data layers.
• Experience building scalable ETL/ELT pipelines, Delta Lake models, data quality controls, and analytics-ready datasets. Positive to Have:
• Experience with Power BI and Python for analytics enablement, data preparation, or supporting downstream data products.
Education:
Any graduate degree; any academic branch considered.
📌 Data Engineer_105345 (Bengaluru)
🏢 MyCareernet
📍 Bengaluru