Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Intermediate Azure Databricks Developer
Position: Software Engineer
Experience: 5- 10 Years
Category: Software Development/ Engineering
Main location: Bangalore, Hyderabad
Employment Type: Full Time
LI-AD12
Your future duties and responsibilities:
Intermediate data bricks developer with 5-9 years of experience
We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure. The ideal candidate will have robust expertise in PySpark, Azure Data Lake, and data engineering best practices in a cloud environment.
Key Responsibilities:
Design and implement ETL/ELT pipelines using Azure Databricks and PySpark.
Work with structured and unstructured data from diverse sources (e.g., ADLS Gen2, SQL DBs, APIs).
Optimize Spark jobs for performance and cost-efficiency.
Collaborate with data analysts, architects, and business stakeholders to understand data needs.
Develop reusable code components and automate workflows using Azure Data Factory (ADF).
Implement data quality checks, logging, and monitoring.
Participate in code reviews and adhere to software engineering best practices.
Required qualifications to be successful in this role: