Job DescriptionExp: 6+ years
nWork Mode: Hybrid (3 days work from office) or Remote can also be provided.
nKey Responsibilities
n
- n
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.n
- Implement data ETL processes for batch and streaming analytics requirements.n
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.n
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.n
- Ensure data security, integrity, and compliance throughout the infrastructure.n
- Maintain documentation and contribute to architecture reviews.n
- Participate in incident response and operational excellence initiatives for the data warehouse.n
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.n

nRequired Skills and Experience




n
- n
- Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL.n
- Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.n
- Proven ability to design and implement automated data pipelines and materialized views.n
- Proficiency in Python, Unix or similar languages.n
- Valuable understanding of SQL oracle, SQL server or similar languages.n
- Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions).n
- Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code.n
- 5+ years of directly applicable experiencen
- BS in Computer Science, Engineering, or equivalent experience.n

📌 Data Engineer (Karnataka)
🏢 ACL Digital
📍 Karnataka