10 Oct
|
Latentview
|
Chennai
10 Oct
Latentview
Chennai
Designation : Assistant Manager - Data Engineering
Level : L3
Location : Chennai, Tamil Nadu , India (CHN)
Experience : 5 to 8 Years
Job Role :
We are seeking a Lead / Senior Data Analytics Engineer to drive the design, development, and delivery of enterprise data platforms. You will act as a technical authority for data pipelines, data warehousing, and big data architecture while providing technical guidance to junior/mid-level team members. In addition to core data engineering expertise, experience leveraging AI / GenAI to accelerate data modeling, pipeline automation, and code generation is highly desirable.
Responsibilities :
Architecture & Design: Design and architect scalable, high-throughput, and reliable end-to-end data systems (databases, warehouses, and big data platforms) adhering to data governance, privacy, and compliance standards.
Lead & Technical Delivery: Drive the end-to-end technical delivery of complex data initiatives. Translate broad business requirements into robust, production-grade technical designs.
Pipeline Engineering: Lead the implementation and optimization of complex ETL/ELT data pipelines using SQL, PySpark, Hive, and Airflow across large-scale distributed environments.
Team Leadership & Mentorship:
Provide technical leadership, code reviews, and architectural guidance to junior and mid-level data engineers to enforce best practices and quality standards.
Stakeholder Management: Collaborate with business leadership, product managers, and enterprise architects to align data strategies with overall organization goals.
AI & Innovation: Leverage AI / GenAI tools to streamline pipeline generation, query optimization, automated test suite generation, and metadata management.
Required skills :
Advanced PySpark, Advanced SQL, Data Architecture & Design, Big Data Ecosystem ;Hadoop, HDFS, Hive, Airflow / Workflow Orchestration, Data Warehousing (Snowflake / Redshift / BigQuery).
Enterprise Cloud Platforms (AWS / GCP / Azure), CI/CD & DevOps for Data Platforms, GenAI / AI-driven pipeline automation, Data Governance & Quality Frameworks, Streaming (Kafka / Spark Streaming).
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Assistant Manager - Data Engineering (Chennai)
🏢 Latentview
📍 Chennai