Exp: 6+ years

nWork Mode: Hybrid (3 days work from office) or Remote can also be provided.

n

nKey Responsibilities

n

n
Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
n
Implement data ETL processes for batch and streaming analytics requirements.
n
Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
n
Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
n
Ensure data security, integrity, and compliance throughout the infrastructure.
n
Maintain documentation and contribute to architecture reviews.
n
Participate in incident response and operational excellence initiatives for the data warehouse.
n
Continuously learn mindset and apply recent Hadoop ecosystem tools and data technologies.
n

n

nRequired Skills and Experience





n

n
Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.
n
Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
n
Proven ability to design and implement automated data pipelines and materialized views.
n
Proficiency in Python, Unix or similar languages.
n
Positive understanding of SQL oracle, SQL server or similar languages.
n
Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions).
n
Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code.
n
5+ years of directly applicable experience
n
BS in Computer Science, Engineering, or equivalent experience.
n

n

📌 Data Engineer Bengaluru
🏢 ACL Digital
📍 Bengaluru