07 Aug
|
Coditas Technologies
|
Pune
07 Aug
Coditas Technologies
Pune
Job Description
We are looking for data engineers who have the right attitude, aptitude, skills, empathy,
compassion, and hunger for learning. Build products in the data analytics space. A passion
for shipping high-quality data products, interest in the data products space; curiosity about
the bigger picture of building a company, product development and its people.
Roles and Responsibilities
Develop and manage robust ETL pipelines using Apache Spark (Scala)
Understand park concepts, performance optimization techniques and governance
tools
Develop a highly scalable, reliable, and high-performance data processing pipeline to
extract, transform and load data from various systems to the Enterprise Data
Warehouse/Data Lake/Data Mesh
Collaborate cross-functionally to design effective data solutions
Implement data workflows utilizing AWS Step Functions for effective orchestration.
Leverage AWS Glue and Crawler for seamless data cataloging and automation
Monitor, troubleshoot, and optimize pipeline performance and data quality
Maintain high coding standards and produce thorough documentation.
Contribute to
high-level (HLD) and low-level (LLD) design discussions
Technical Skills
Minimum 3 years of progressive experience building solutions in Big Data
settings.
Have a strong ability to build robust and resilient data pipelines which are scalable,
fault tolerant and reliable in terms of data movement.
3+ years of hands-on expertise in Python, Spark and Kafka.
Strong command of AWS services like EMR, Redshift, Step Functions, AWS Glue, and
AWS Crawler.
Solid hands on capabilities on SQL and NoSQL technologies.
Sound understanding of data warehousing, modeling, and ETL concepts
Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
Excellent written and verbal communication skills.
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: Any Graduate
📌 Aws Data Engineer Pune
🏢 Coditas Technologies
📍 Pune