Role
Technology Lead
Number of Openings
2
Detailed JD *(Roles and Responsibilities)
We are looking for highly skilled Data Engineers to join our team for a long-term offshore position. The ideal candidates will have 5+ years of experience in Data Engineering, with a solid focus on Python and programming. The role requires proficiency in leveraging AWS services to build efficient, cost-effective datasets that support Business Reporting and AI/ML Exploration.
Candidates must demonstrate the ability to functionally understand the Client Requirements and deliver Optimized Datasets for multiple Downstream Applications.
The selected individuals will work under the guidance of an Lead from Onsite and closely with Client Stakeholders to meet business objectives.
Key Responsibilities
Cloud Infrastructure:
- Design and implement scalable, cost-effective data pipelines on the AWS platform using services like S3, Athena, Glue, RDS, etc.
- Manage and optimize data storage strategies for efficient retrieval and integration with other applications.
- Support the ingestion and transformation of large datasets for reporting and analytics.
Tooling and Automation:
- Develop and maintain automation scripts using Python to streamline data processing workflows.
- Integrate tools and frameworks like PySpark to optimize performance and resource utilization.
- Implement monitoring and error-handling mechanisms to ensure reliability and scalability.
Collaboration and Communication:
- Work closely with the onsite lead and client teams to gather and understand functional requirements.
- Collaborate with business stakeholders and the Data Science team to provide datasets suitable for reporting and AI/ML exploration.
- Document processes, provide regular updates, and ensure transparency in deliverables.
Data Analysis and Reporting:
- Optimize AWS service utilization to maintain cost-efficiency while meeting performance requirements.
- Provide insights on data usage trends and support th
📌 AWS, SQL and Python (India)
🏢 Infosys
📍 India