Lead Data Engineer (Bengaluru)

Lead Data Engineer (Bengaluru)

01 Oct
|
CGI
|
Bengaluru

01 Oct

CGI

Bengaluru

Position Description

Data Engineer

Mission

- Analyze the business and technical needs of data/AI use cases in collaboration with Product Owners and Data Scientists

- Design and implement robust, scalable, and industrialize data pipelines (ingestion, transformation, exposure)

- Ensure data quality, monitoring and traceability

- Implement and optimize data architectures (batch and real time) according to performance and volume constraints

- Industrialize data flows to support analytical, ML and generative AI use cases (RAG, feature pipelines, etc.)

- Manage data storage and access (data lakes, warehouses, vector databases)

- Collaborate closely with Data Science / MLOps teams to facilitate the deployment of models in production

- Ensure data security and regulatory compliance

- Document pipelines and architectures to ensure maintainability and knowledge sharing

- Contribute to the continuous improvement of Data Engineering practices and the standardization of tools and frameworks

Skills

Must have

- Minimum 7 years of experience in Data Engineering with large scale data pipeline production

- Strong skills in designing distributed data architectures

- Expertise in: Data Engineering : ETL/ELT, data pipelines, data quality, orchestration Big Data : Spark / PySpark, Azure Data Lake, Databricks Stockage : Data Lake, Data Warehouse (Databricks) Databases: Advanced SQL Streaming: Kafka, Event Hub or similar

- Experience on AI/ML use cases with data exposure for models

- GenAI (data interactions): understanding of RAG architectures, management of vector DBs

- Programming: Python, SQL

- Cloud : Azure (Data Factory, Synapse, Data Lake, Event Hub…) ou équivalent

- DevOps & DataOps : Git, CI/CD, Docker, orchestration (Airflow, AWX)

- Best practice of agile methodologies





- Language: French (C1 ) and English (B2 )

Nice to have

- Experience with vector databases (PGVector, Azure AI Search, Weaviate...)

- Connaissance des outils MLOps (MLflow, feature stores)

- Experience in the industrialization of generative AI use cases

- Knowledge of advanced real time architectures

- Development Practices: TDD

- Experience on Kubernetes

Your future duties and responsibilities

Required Qualifications To Be Successful In This Role

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop cutting-edge solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our team—one of the largest IT and business consulting services firms in the world.

📌 Lead Data Engineer (Bengaluru)
🏢 CGI
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (bengaluru) / bengaluru