10 Sep
|
Topcoder
|
Bengaluru
10 Sep
Topcoder
Bengaluru
We are seeking an experienced AWS Data Lake Architect to lead the technical design and architecture of a comprehensive data lake solution and its associated services. You will ensure alignment with customer requirements, industry best practices, and project objectives while maintaining the highest standards of code quality and performance. This role combines architectural leadership, technical review, incident management, and hands-on optimization to deliver a robust, scalable data infrastructure.
Responsibilities
- Lead the technical design and architecture of AWS data lake infrastructure, ensuring scalability, security, and alignment with customer requirements and industry best practices
- Conduct technical code and architecture reviews to ensure adherence to coding standards and drive continuous improvement in code quality and performance
- Design and implement schema optimization strategies in Snowflake and AWS Data Lake to maximize query performance and resource efficiency
- Manage dataset operations including adding, updating, and deleting datasets in the AWS Data Lake while maintaining data integrity and documentation
- Monitor storage usage, plan capacity requirements, and optimize resource allocation to prevent bottlenecks and control costs
- Provide technical support and troubleshooting for AWS platforms and services, resolving incidents, service requests, and enhancement requests with timely resolution
- Communicate technical designs, findings,
and recommendations to stakeholders through clear presentations and documentation
Requirements
- 5+ years of professional experience designing and building data lake solutions on cloud platforms, preferably AWS
- Expert-level proficiency with AWS services including S3, Lambda, Glue, Athena, and related data processing services
- Solid experience with data warehouse platforms, specifically Snowflake or equivalent technologies
- Demonstrated expertise in schema design, data modeling, and query optimization for large-scale analytical workloads
- Experience with data pipeline architecture, ETL/ELT processes, and data quality management
- Proficiency in SQL and at least one scripting language (Python, Bash, or similar) for infrastructure automation
- Strong understanding of data governance, security, and compliance requirements in data platforms
Nice to Have
- AWS Solutions Architect or AWS Database Specialty certification
- Experience with data catalog and metadata management solutions (e.g., AWS Glue Catalog, Apache Atlas)
- Familiarity with machine learning workflows and feature store architecture
- Experience mentoring junior technical staff and contributing to technical strategy within organizations
Skills AWS, Data Lake Architecture, Snowflake, SQL, Python, ETL/ELT, Data Modeling, Query Optimization, Cloud Infrastructure, Data Governance, Schema Design, Problem Solving, Technical Leadership, Communication
Working Hours
1:00 PM IST to 10:30 PM IST
📌 Cloud Architect (Bengaluru)
🏢 Topcoder
📍 Bengaluru