Roles and Responsibilities :

- Design, develop, and maintain large-scale data pipelines using Apache NiFi to integrate multiple sources into a centralized data lake.

- Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data ingestion, processing, and monitoring.

- Develop high-performance ETL processes using Python or Java to extract, transform, and load (ETL) large datasets from various sources such as Kafka, PostgreSQL, Parquet files.

- Ensure seamless deployment of data pipelines on Docker containers running on Kubernetes clusters.

Job Requirements :

- 7-10 years of experience in building complex data integration projects using tools like Apache NiFi.

- Solid understanding of big data technologies including Hadoop ecosystem components like HDFS, YARN, MapReduce etc. .

- Proficiency in programming languages such as Python or Java for developing ETL processes.

- Experience working with containerization engines like Docker and orchestration platforms like Kubernetes.

📌 Lead Data Engineer - Apache NiFi (Bengaluru)
🏢 EdgeVerve Systems
📍 Bengaluru