22 Sep
|
Isoft Services Noida
|
Hyderabad
22 Sep
Isoft Services Noida
Hyderabad
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract insights from various sources.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop ETL processes using Hadoop Distributed File System (HDFS), Spark, Python, SQL, Scala or other technologies as required.
- Troubleshoot issues related to data quality, performance optimization and scalability of the pipeline.
Job Requirements :
- 4-12 years of experience in Data Engineering with expertise in big data processing tools such as Hive, Sqoop etc. .
- Robust understanding of programming languages including Python, Scala or PySpark.
- Experience working with cloud-based platforms like AWS/Azure/GCP for deploying applications.
📌 Data Engineer (Hyderabad)
🏢 Isoft Services Noida
📍 Hyderabad