10 Sep
|
ProArch
|
Bengaluru
We are seeking an experienced AWS Glue Python Developer to design, develop, and support scalable cloud-based inbound and outbound file based data integration and processing solutions. The ideal candidate will have robust expertise in Python, AWS Glue, PySpark, and serverless AWS services.
The candidate will work with business and technical teams to develop reliable data processing workflows using services such as Amazon S3, EventBridge, Lambda, SNS, SQS, CloudWatch, IAM, and AWS Step Functions or Glue Workflows.
Key Responsibilities
Design and develop inbound and outbound file processing using AWS Glue, Python, and PySpark.
Develop reusable Python modules, utilities, and frameworks for data ingestion, validation, transformation, and error handling.
Build batch inbound and outbound file processing using Amazon S3 and AWS Glue.
Configure Amazon EventBridge rules for scheduling and event-based processing.
Develop AWS Lambda functions for lightweight processing, automation, validation, and integration activities.
Implement messaging and notification solutions using Amazon SNS and Amazon SQS.
Configure Amazon CloudWatch logs, metrics, dashboards, and alarms for operational monitoring.
Develop workflows using AWS Glue Workflows, AWS Step Functions, or equivalent orchestration services.
Integrate AWS services with relational databases, APIs, file systems, and external applications.
Implement data ingestion from CSV, XML, JSON, Excel, fixed-length, variable-length, and delimited files.
Develop data validation, reconciliation, audit, retry, and exception-handling processes.
Optimize AWS Glue jobs for performance, scalability, and cost efficiency.
Implement secure access using AWS IAM roles, policies, encryption, and secrets management.
Support production deployments, incident resolution, root-cause analysis, and performance tuning.
Collaborate with DevOps teams to implement CI/CD pipelines for AWS Glue jobs and related infrastructure.
Prepare technical documentation, data fl
📌 AWS Glue Python Developer (Bengaluru)
🏢 ProArch
📍 Bengaluru