Role Summary In the first few months, you will successfully build and manage robust data pipelines that streamline the flow of information across our cloud-based platforms.

Responsibilities - Design, develop, and maintain data pipelines using Cloud Composer and Apache Airflow.

- Implement ETL processes in Python and PySpark to facilitate the transformation of data.
- Write effective SQL queries to support data retrieval and analysis.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Manage and optimize cloud infrastructure on GCP and AWS to ensure scalability and performance.
- Monitor and troubleshoot data workflows to ensure reliability and accuracy of data processing. Must-Have Skills - Proficiency in Cloud Composer and Apache Airflow for workflow orchestration.




- Strong programming skills in Python and experience with PySpark.
- Solid understanding of SQL for database management and querying.
- Hands-on experience with Google Cloud Platform (GCP) services.
- Familiarity with Amazon Web Services (AWS) for cloud solutions. Good-to-Have Skills - Experience with big data technologies such as Hadoop or Spark.
- Knowledge of data warehousing concepts and tools.
- Background in machine learning or data science concepts may be beneficial. If you're ready to take the next step in your career as a Data Engineer, we encourage you to apply today!

Industry

Recruitment Services

Department

Recruitment

📌 Data Engineer (Bengaluru)
🏢 Transcendence Human Resources Private
📍 Bengaluru