- Design, develop, and maintain large-scale data pipelines using Apache NiFi to integrate various sources of data into a centralized data lake.
- Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data ingestion, processing, and monitoring.
- Develop high-performance ETL processes using Python or Java to extract insights from structured and unstructured datasets stored in PostgreSQL databases.
- Ensure seamless deployment of data workflows on Kubernetes clusters using Docker containers.
Job Requirements :
- 7-10 years of experience in building complex data pipelines using Apache NiFi or similar tools (e.g., Airflow).
- Solid proficiency in programming languages such as Python or Java for developing ETL processes.
- Experience working with big-data technologies like Parquet files, Kafka messaging queues, and Docker containerization.
📌 Data engineer Lead - Apache NiFi Mandatory (Pune)
🏢 EdgeVerve Systems
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.