Over 5 years of experience in development of AWS SQS Glue python pyspark dynamic frame dataframe Demonstrated competency with the following AWS services ECS EC2 ECR S3 RDS VPC IAM QuickSight CloudFront CloudFormation CloudWatch SQS ElastiCache Lambda Glue ETL Dynamodb Neptune route53 Application Load balancers ECS SQS Strong knowledge on developing code using terraform IAAC tool Experienced in using GIT SCM tool Valuable hands on experience on using jenkins or Gitlab CI tool worked as admin or developer depending on day to day scenarios Good hands on experience on containerization tools like docker kubernetes Strong experience on handling containers pods clusters in a robust environments Robust Data Engineering background with the ability to implement Spark based or AWS Lambda based or glue based ETL jobs Knowledge of operating system administration Comprehensive knowledge regarding contemporary processes and methodologies for development and operations Strong understanding of how to secure AWS environments and meet compliance requirements AWS Disaster Recovery design and deployment across regions a plus Experience with multi-tier architectures load balancers caching web servers application servers databases and networking Great communication and interpersonal skills Job Title Senior Software Engineer Position Python developer Experience 5-8 years Category General Main location Hyd chennai Bangalore Work Type Hybrid Your future duties and responsibilities Design develop and maintain scalable ETL pipelines using AWS Glue Python and PySpark Build data ingestion and transformation workflows leveraging DynamicFrame DataFrame APIs Develop serverless and event-driven solutions using AWS Lambda and SQS Manage data storage solutions using S3 DynamoDB and RDS with secure IAM governance Deploy and automate cloud infrastructure using Terraform IaC and CI CD tools Containerize and orchestrate applications using Docker and Kubernetes for robust execution environments Monitor system performance troubleshoot production issues and optimize data workflows Collaborate with cross-functional teams to deliver high-quality cloud data solutions Apply AWS security best practices and compliance guidelines in production environments Support multi-tier architectures across application data and networking layers Required qualifications to be successful in this role Must to Have 5 years of hands-on experience with AWS Cloud services such as Glue SQS Lambda S3 DynamoDB EC2 VPC IAM Strong development experience in Python and PySpark for ETL workloads Expertise in DynamicFrame and DataFrame-based data processing in Glue Hands-on experience with Terraform for infrastructure automation Proficiency with CI CD and version control tools Git Jenkins or GitLab CI Strong fundamentals in Linux OS administration and cloud networking Good knowledge of Docker Kubernetes and containerized deployments Solid understanding of cloud security and operational best practices Good to Have Experience with AWS Neptune QuickSight and CloudFront Knowledge of AWS Disaster Recovery strategies and multi-region high availability Familiarity with Step Functions EventBridge and microservices design patterns Experience managing load balancing caching and distributed architectures AWS Certifications Developer Solutions Architect DevOps Engineer Strong communication problem-solving and collaboration skills Together as owners let s turn meaningful insights into action Life at CGI is rooted in ownership teamwork respect and belonging Here you ll reach your full potential because You are invited to be an owner from day 1 as we work together to bring our Dream to life That s why we call ourselves CGI Partners rather than employees We benefit from our collective success and actively shape our company s strategy and direction Your work creates value You ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise You ll shape your career by joining a company built to grow and last You ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons Come join our team one of the largest IT and business consulting services firms in the world