10 Aug
|
Modern Agile Technologies
|
India
10 Aug
Modern Agile Technologies
India
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform services.
- Build and optimize data solutions using BigQuery, Dataflow, DataProc, Dataform, and Pub/Sub.
- Develop ETL/ELT workflows using Python, SQL, and PySpark.
- Orchestrate and schedule data workflows using Apache Airflow.
- Implement CI/CD pipelines and maintain source code using Git.
- Optimize data processing performance, reliability, and scalability.
- Work closely with business stakeholders to understand requirements and deliver effective data solutions.
- Participate in architecture discussions and provide technical leadership to the engineering team.
- Follow Agile methodologies and SDLC best practices throughout the development lifecycle.
- Prepare daily status reports and communicate project updates with customers and stakeholders.
- Troubleshoot production issues and ensure timely resolution.
Required Skills :
- Strong experience with Google Cloud Platform (GCP).
- Expertise in BigQuery, Dataflow, DataProc, Dataform, and Pub/Sub.
- Strong proficiency in SQL and Python.
- Hands-on experience with PySpark.
- Experience with Apache Airflow for workflow orchestration.
- Knowledge of Cloud SQL and Dataplex.
- Experience with Git and CI/CD pipelines.
- Solid understanding of Software Development Life Cycle (SDLC).
- Familiarity with Agile development methodologies.
Preferred Skills :
- Experience designing enterprise-scale cloud data platforms.
- Exposure to data governance and cloud security best practices.
- Strong debugging, analytical, and problem-solving abilities.
- Experience mentoring junior engineers and leading technical discussions.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience :
- 8 - 12 years of experience in Data Engineering.
- Proven experience building scalable cloud-based data platforms using Google Cloud Platform.
- Strong expertise in Python, SQL, PySpark, Airflow, and GCP data services.
- Experience leading technical initiatives and collaborating with cross-functional teams in Agile environments.
📌 Data Engineer - Google Cloud Platform (India)
🏢 Modern Agile Technologies
📍 India