Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Python Pyspark Developer
Position: Senior Software Engineer
Experience: 5- 8 Years
Category: Software Development/ Engineering
Shift: General
Main location: Hyderabad, Bangalore, Chennai
Position ID: J0626-0794
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant experience.
Position Description: We are currently seeking a proficient Python and AWS developer with a minimum of 5+ years of experience and a robust background in AWS Databricks, Python/Pyspark. The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring seamless data integration and transformation across systems.
Your future duties and responsibilities:
• Design and implement ETL pipelines using PySpark and AWS Glue.
• Develop and optimize data processing frameworks on large-scale datasets.
• Work extensively with AWS services such as Glue, Lambda, ECS, S3, DynamoDB, and CloudWatch.
• Build and maintain data ingestion and transformation workflows.
• Develop and manage Python-based automation and data transformation scripts.
• Collaborate with cross-functional teams to ensure data availability, quality, and performance.
• (Positive to have) Develop and integrate RE