Company Profile:
Your future duties and responsibilities
Job Title: Data Engineer (Azure & Databricks)
Position: Lead Analyst
Experience: 10-12 Years
Category: Software Development / Engineering
Shift: General Shift
Work Mode: Work from Office / Hybrid (as per business requirement)
Primary Location: India, Karnataka, Bangalore
CGI Office: Bangalore
Employment Type: Full Time
Required qualifications to be successful in this role
About the Role:
We are seeking a highly experienced and technically hands on Lead Data Engineer to design, build, and optimize our next generation Enterprise Data Warehouse and data Lakehouse solutions. You will be responsible for leading complex data integration initiatives, migrating legacy workloads, and building highly scalable ETL/ELT pipelines using Python, Databricks, and the Azure Cloud ecosystem.
As a technical leader, you will collaborate closely with enterprise architects, business stakeholders, and data scientists to ensure our data infrastructure is robust, secure, and aligned with business objectives.
Mandatory Key Responsibilities:
. Architecture & Design: Design and implement up-to-date, scalable Data Warehousing and Data Lakehouse architectures on Microsoft Azure using Databricks and Delta Lake.
. ETL/ELT Development: Architect, build, and maintain highly efficient data pipelines to ingest, clean, transform, and load massive volumes of data from various sources (relational, non relational, APIs, flat files).
. Databricks & PySpark Mastery: Write optimized, production grade PySpark and Python code in Azure Databricks for complex data transformations and advanced analytics.
. Legacy Modernization: Lead the migration of legacy Enterprise Data Warehouse (EDW) workloads (e.g., traditional SQL stored procedures, Unix scripts, legacy ETL tools) to a modern Azure/Databricks cloud stack.
. Azure Infrastructure: Utilize and orchestrate Azure native services including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure
📌 Data Engineer (Bengaluru)
🏢 CGI
📍 Bengaluru