15 Sep
|
FetchJobs.co
|
India
15 Sep
FetchJobs.co
India
About The Company
YMinds.AI is a forward-thinking technology and talent solutions provider dedicated to bridging the gap between innovative businesses and top-tier technology professionals. Our mission is to empower organizations by building high-performance engineering teams capable of driving digital transformation. With a deep understanding of the evolving tech landscape, YMinds.AI specializes in sourcing, evaluating, and delivering skilled talent across a broad spectrum of emerging and established technology domains.
Our commitment to quality, integrity, and customer satisfaction positions us as a trusted partner for companies seeking to enhance their technical capabilities and achieve strategic growth.
About The Role
We are seeking an experienced AWS Data Engineer to join our client's dynamic team. The ideal candidate will have over four years of hands-on experience in data engineering, with a strong focus on developing scalable, reliable, and cost-efficient data solutions in the cloud. This role involves designing, building, and maintaining data pipelines and cloud-based data infrastructure that support analytics, reporting, and decision-making processes.
The candidate will work closely with business stakeholders and cross-functional teams to translate complex requirements into effective data architectures, ensuring high data quality, performance, and security. The position offers an excellent chance to work on cutting-edge cloud technologies and contribute to impactful data initiatives within a collaborative environment.
Qualifications The successful candidate should possess a minimum of four years of practical experience in data engineering, with a strong proficiency in Python, PySpark, and SQL.
A solid understanding of AWS services such as Glue, S3, Redshift, Athena, and Lambda is essential, along with familiarity with supporting services like SNS, SQS, CloudWatch, EventBridge, and API Gateway. Candidates should demonstrate expertise in designing and optimizing ETL/ELT workflows, managing data pipelines, and ensuring data integrity and security.
Excellent problem-solving skills, effective communication, and the ability to collaborate with diverse teams are critical. Prior experience with streaming data platforms, workflow orchestration tools, and infrastructure as code practices are considered advantageous.
Responsibilities
- Design, develop, and maintain scalable data pipelines utilizing Python and PySpark to facilitate efficient data ingestion, transformation, and processing.
- Create and optimize ETL/ELT workflows to automate data workflows, ensuring timely and accurate data delivery.
- Write complex SQL queries for data transformation, validation, and analytical purposes, optimizing for performance and resource utilization.
- Build and manage cloud-based data solutions leveraging AWS Glue, S3, Redshift, Athena, and Lambda, integrating with other AWS services such as SNS, SQS, CloudWatch, EventBridge, and API Gateway for automation and monitoring.
- Ensure data quality by troubleshooting pipeline issues, implementing validation checks,
and continuously improving data reliability and performance.
- Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders to understand requirements and translate them into scalable data architectures.
- Implement cost optimization strategies for cloud data solutions, monitoring resource utilization and applying best practices for efficiency.
Benefits Our client offers a competitive compensation package aligned with industry standards, including comprehensive health benefits, retirement plans, and paid time off. Employees gain access to ongoing career development opportunities, training programs, and certifications to enhance their skills. The organization fosters a collaborative and innovative work environment that values diversity, inclusion, and work-life balance. Additionally, team members have the chance to work on impactful projects using the latest cloud technologies, contributing to the growth of the organization and their personal career trajectories. Flexibility in work arrangements and a supportive leadership team further enhance the overall employee experience.
Equal Opportunity
Our client is an equal opportunity employer committed to fostering a diverse and inclusive workplace. We do not discriminate based on race, ethnicity, gender, age, religion, disability, sexual orientation, or any other protected characteristic. We believe that a diverse workforce enhances innovation and drives better business outcomes. All qualified candidates are encouraged to apply and will receive consideration for employment without regard to any protected status.
📌 Data Engineer (India)
🏢 FetchJobs.co
📍 India