02 Aug
|
TechVariable
|
India
02 Aug
TechVariable
India
Full Time
Remote
Experience -
8+
CTC-
Best In Industry
Job Description
We are looking for a highly skilled and motivated Solution Architect with deep expertise in designing and implementing innovative big data solutions on the Amazon Web Services (AWS) platform. As a key member of our team, you will lead the architecture and development of scalable, high-performance, and secure data systems, playing a critical role in driving our data-driven initiatives forward.
Roles and Responsibilities
- Solution Architecture & Design
- Collaborate with product managers, engineers, and data scientists to gather business requirements and translate them into efficient, scalable data solutions on AWS.
- Architect AWS-based big data systems using services such as S3, EMR, Glue, Redshift, DynamoDB, Lambda, and Athena.
- Design well-architected and cost-effective solutions aligned with industry best practices.
Technology Leadership
- Stay current with AWS advancements and big data technologies to evaluate and recommend appropriate tools.
- Provide technical leadership and mentorship to the data engineering team, promoting a collaborative and innovative setting.
- Implementation & Optimization
- Oversee the end-to-end development lifecycle—from proof of concept to production deployment.
- Identify and resolve performance bottlenecks, ensuring optimal scalability and cost-efficiency.
- Ensure solutions meet security, compliance, and data governance standards.
- Collaboration & Communication
- Work closely with both technical and non-technical stakeholders to communicate solutions and guide decision-making.
- Create and maintain documentation for architecture, data pipelines, and engineering processes.
- Support & Maintenance
- Assist in troubleshooting and resolving technical issues.
- Ensure the reliability, accuracy, and consistency of data across pipelines.
Required Skills
- AWS Big Data Services: S3, EMR, Glue, Glue Catalog, Lambda, Redshift, DynamoDB, Athena, SageMaker
- Workflow Orchestration: Airflow
- Programming: Python, PySpark
- Data Management: SQL, data modeling, warehousing, transformation, and integration
- Security: IAM, encryption, and compliance implementation
- Version Control: Git / Bitbucket
Nice to Have: Experience with training/processing jobs in SageMaker, Unix/Linux scripting, and Apache Spark/Flink/Hadoop
📌 Solution Architect – AWS (India)
🏢 TechVariable
📍 India