08 Oct
|
Edstem Technologies
|
Thiruvananthapuram
08 Oct
Edstem Technologies
Thiruvananthapuram
Location: Trivandrum, Kerala (Work from Office)
Experience: 3 – 7 Years
Notice Period: Immediate Joiners Preferred
About the Role
We are seeking an experienced and results-driven Data Engineer with 3 to 7 years of expertise in designing, building, and optimizing data pipelines and data infrastructure. Based in Trivandrum, you will work closely with cross-functional software engineering, product, and analytics teams to transform raw data into scalable, high-performance data assets that power business intelligence and advanced analytics.
Key Responsibilities• Pipeline Engineering: Design, construct, and maintain robust, scalable ETL/ELT data pipelines from a wide variety of batch and streaming data sources.
• Architecture & Data Modeling: Create and optimize relational and non-relational data models (Data Warehousing, Data Lakes, Data Marts) tailored for reporting and analytical performance.
• System Optimization: Identify, debug, and resolve pipeline bottlenecks to maximize processing efficiency, query speed, and system reliability.
• Data Quality & Governance:
Implement automated data validation, quality monitoring, and tracking mechanisms to ensure end-to-end data integrity and security compliance.
• Agile Collaboration: Participate in sprint planning, technical refinements, and architecture discussions within a cross-functional engineering team.
• Stakeholder Support: Partner with data analysts, data scientists, and business stakeholders to understand data requirements and deliver performant data products.
Requirements & Qualifications• Experience: 3 to 7 years of hands-on experience in Data Engineering, Data Platform Development, or ETL/ELT pipeline design.
• Core Technical Stack: Advanced proficiency in Python, SQL, and data processing frameworks (e.g., PySpark, Apache Spark).
• Data Warehousing: Solid experience working with contemporary cloud data platforms (e.g., Snowflake, AWS Redshift, Google BigQuery, or Databricks).
• Database & Cloud Expertise: Robust knowle
📌 Data Engineer Thiruvananthapuram
🏢 Edstem Technologies
📍 Thiruvananthapuram