Position Description
Data Engineer
Mission
- Analyze the business and technical needs of data/AI use cases in collaboration with Product Owners and Data Scientists
- Design and implement robust, scalable, and industrialize data pipelines (ingestion, transformation, exposure)
- Ensure data quality, monitoring and traceability
- Implement and optimize data architectures (batch and real time) according to performance and volume constraints
- Industrialize data flows to support analytical, ML and generative AI use cases (RAG, feature pipelines, etc.)
- Manage data storage and access (data lakes, warehouses, vector databases)
- Collaborate closely with Data Science / MLOps teams to facilitate the deployment of models in production
- Ensure data security and regulatory compliance
- Document pipelines and architectures to ensure maintainability and knowledge sharing
- Contribute to the continuous improvement of Data Engineering practices and the standardization of tools and frameworks
Skills
Must have
- Minimum 7 years of experience in Data Engineering with large scale data pipeline production
- Strong skills in designing distributed data architectures
- Expertise in: Data Engineering : ETL/ELT, data pipelines, data quality, orchestration Big Data : Spark / PySpark, Azure Data Lake, Databricks Stockage : Data Lake, Data Warehouse (Databricks) Databases: Advanced SQL Streaming: Kafka, Event Hub or similar
- Experience on AI/ML use cases with data exposure for models
- GenAI (data interactions): understanding of RAG architectures, management of vector DBs
- Programming: Python, SQL
- Cloud : Azure (Data Factory, Synapse, Data Lake, Event Hub…) ou équivalent
- DevOps & DataOps : Git, CI/CD, Docker, orchestration (Airflow, AWX)
- Best practice of agile methodologies
- Language: French (C1 ) and English (B2 )
Nice to have
- Experience with vector databases (PGVector, Azure AI Search, Weaviate...)
- Connaissance des outils MLOps (MLflow, feature stores)
- Experience in the industrialization of generative AI use cases
- Knowledge of advanced real time architectures
- Development Practices: TDD
- Experience on Kubernetes
Your future duties and responsibilities
Required Qualifications To Be Successful In This Role
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop cutting-edge solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Come join our team—one of the largest IT and business consulting services firms in the world.
📌 Lead Data Engineer (Bengaluru)
🏢 CGI
📍 Bengaluru