We are seeking a highly skilled Solutions Architect with 5+ years of experience in Data Engineering, specializing in AWS platforms, Python, and SQL. You will be responsible for designing and implementing scalable, cost-effective data pipelines on AWS, optimizing data storage, and supporting the ingestion and transformation of large datasets for business reporting and AI/ML exploration. This role requires robust functional understanding of client requirements, the ability to deliver optimized datasets, and adherence to security and compliance standards.
Roles & Responsibilities:
- Design and implement scalable, cost-effective data pipelines on the AWS platform using services like S3, Athena, Glue, RDS, etc.
- Manage and optimize data storage strategies for efficient retrieval and integration with other applications.
- Support the ingestion and transformation of large datasets for reporting and analytics.
- Develop and maintain automation scripts using Python to streamline data processing workflows.
- Integrate tools and frameworks like PySpark to optimize performance and resource utilization.
- Implement monitoring and error-handling mechanisms to ensure reliability and scalability of data solutions.
- Work closely with onsite leads and client teams to gather and understand functional requirements.
- Collaborate with business stakeholders and the Data Science team to provide optimized datasets suitable for Business Reporting and AI/ML Exploration .
- Document processes, provide regular updates, and ensure transparency in deliverables.
- Optimize AWS service utilization to maintain cost-efficiency while meeting performance requirements.
- Provide insights on data usage trends and support the development of reporting dashboards for cloud costs.
- Ensure secure handling of sensitive data with encryption (e.g., AES-256, TLS) and role-based access control using AWS IAM.
- Maintain compliance with organizational and industry regulations for data solutions.
Skills Required
📌 Solutions Architect (Pune)
🏢 Apex 2000
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.