Section III - Job Requirements and Responsibilities
Job Requirements*
- Strong Python, PySpark, GCP, BigQuery, SQL, Airflow, Astronomer
- Experience in ETL/ELT pipeline development
- Strong data structures knowledge
- Experience with Git, NoSQL databases
- Strong problem solving and analytical skills
Key Responsibilities*
- Develop and maintain data pipelines
- Work on Airflow DAGs using Astronomer
- Perform unit testing and ensure code quality
- Collaborate with stakeholders
- Maintain documentation and follow Agile