Company Name VARITE India Private Limited About The Client Client is an Indian multinational technology company specializing in information technology services and consulting Headquartered in Mumbai it is a part of the Tata Group and operates in 150 locations across 46 countries Essential Job Functions Design develop implement and maintain robust and scalable ETL pipelines using Python and SQL as well as AWS Glue and AWS Lambda for data ingestion transformation loading into various data targets e g PostgreSQL Client S3 Redshift Aurora and structured data management Translate business requirements and data models into efficient and secure data processing solutions Pull data using APIs and handle large datasets efficiently Integrate data from various sources including REST APIs OAuth JWT Basic Auth CSVs and relational databases ensuring accurate configuration optimization and schema definitions Optimize code and reduce ETL execution time through performance tuning and error handling best practices Write test and deploy AWS Glue ETL scripts Python PySpark or Scala to perform complex data transformations cleansing aggregation and enrichment Implement security best practices for data in transit and at rest Automate job execution using cron or other scheduling tools and monitor pipeline health Use Git for version control maintaining CI CD hygiene for data scripts and managing ETL code through various branching strategies Troubleshoot and debug complex ETL workflows and provide RCA for failures Work on Linux-based systems with shell scripting for operational support Collaborate effectively with business users and data engineers through Pull Request PR Merge Request MR workflows to gather requirements and document workflows Ensure code quality data quality consistency and timely delivery of all scheduled data loads while adhering to branching policies to ensure isolated changes and preventing conflicts with ongoing work Participate in code review processes providing constructive feedback and ensuring that proposed changes align with data integrity performance and security standards before merging into shared branches Manage the promotion of ETL code across different environments e g Development Staging Production by adhering to defined branching and release strategies ensuring smooth and controlled deployments Participate in Agile rituals such as daily stand-up meetings and other project meetings to contribute to achieve project deliverables within required timeframe Maintain regular communication with supervisor and continually update needs priorities and risks to the supervisor Critical analytical problem-solving skills is essential Be able to communicate clearly the message via oral communication and written communication Possess an assertive communication style but maintain a positive relationship with all team members and stakeholders Strong focus on continuous learning and improvement Qualifications Skill Required Digital Client Web Service AWS Cloud Computing Experience Range 6-8yrs Essential Skills AWS Glue Hands-on experience in coding techniques with a proven record Hands-on experience in end-to-end data workflows including pulling data from third-party and in-house tools via APIs transforming and loading it into data warehouses and improving performance across the ETL lifecycle Hands-on experience with scripting Python shell scripting relational databases PostgreSQL Redshift REST APIs OAuth JWT Basic Auth job scheduler cron version control system Git and in AWS setting Hands-on experience in integrating data from various data sources Understanding of Agile processes and principles Good communication and presentation skills Desirable Hands-on experience in integrating data from various data sources Understanding of Agile processes and principles Good communication and presentation skills How to Apply Interested candidates are encouraged to respond submit their updated resumes and for additional job opportunities please visit Unlock Rewards Refer Candidates and Earn If you re not available or interested in this opportunity please pass this along to anyone in your network who might be a good fit and interested in our open positions VARITE offers a Candidate Referral program where you ll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE Experience Level Bonus Referral 0-2 years INR 5 000 2-6 years INR 7 500 6 years INR 10 000 About VARITE VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA UK CANADA and INDIA VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking Cloud Infrastructure Hardware and Software Digital Marketing and Media Solutions Clinical Diagnostics Utilities Gaming and Entertainment and Financial Services Equal Opportunity Employer VARITE is an equal opportunity employer We celebrate diversity and are committed to creating an inclusive environment for all employees We do not discriminate on the basis of race color religion sex sexual orientation gender identity or expression national origin age marital status veteran status or disability status

📌 Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru