- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract insights from various sources such as PostgreSQL databases.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop scalable data processing workflows using Apache Flink or PySpark on AWS cloud platform.
- Ensure high-quality data delivery by implementing robust testing frameworks and monitoring dashboards in Snowflake.
Job Requirements :
- 6-10 years of experience in Data Engineering with expertise in Airflow, Apache Flink, Python (PySpark), PostgreSQL, SQL.
- Robust understanding of big data technologies like Hadoop ecosystem (HDFS) and Spark (Scala).
- Experience working with cloud-based platforms like AWS for deploying applications.
📌 Data Engineer (Bengaluru)
🏢 Arotha Profconsul
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.