19 Aug
|
Navikenz India
|
Noida
19 Aug
Navikenz India
Noida
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.
- Develop ETL processes using PySpark on Azure Databricks to extract insights from various sources of structured and unstructured data.
- Ensure high availability, scalability, security and performance of the data pipeline by monitoring its metrics.
Job Requirements :
- 8-12 years of experience in Data Engineering with expertise in AWS services (S3, Lambda) and Microsoft Azure platform.
- Robust understanding of Big Data technologies like Hadoop ecosystem (HDFS), Spark (PySpark) and Kafka.
- Experience working with cloud-based platforms for building scalable data pipelines.
📌 Data Engineer (Noida)
🏢 Navikenz India
📍 Noida