01 Oct
|
LanceSoft
|
Pune
Job Location: Pune
Job Type: WFO (5 Days)
Primary skills : GCP, Big Query, Cloud Composer, python
Job Summary:
We are seeking a highly skilled and motivated Data Engineer with 46 years of experience in Google Cloud Platform (GCP), BigQuery, Cloud Composer, and Python. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and cloud-native solutions to support analytics, reporting, and data-driven decision-making.
Key Responsibilities:
- Design and implement scalable data pipelines using Cloud Composer (Apache Airflow).
- Develop and optimize SQL queries for BigQuery to support analytics and reporting.
- Write effective and reusable Python scripts for data transformation, automation, and orchestration.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data quality, integrity, and security across all pipelines and storage layers.
- Monitor and troubleshoot data workflows and cloud infrastructure.
- Implement CI/CD practices for data pipeline deployment and versioning.
- Maintain documentation for data architecture, workflows, and processes.
Required Skills & Qualifications:
- 4–6 years of hands-on experience with GCP services, especially BigQuery, Cloud Composer, and Cloud Storage.
- Strong proficiency in Python for scripting and automation.
- Experience with Airflow DAGs, scheduling, and dependency management.
- Solid understanding of SQL and data modeling concepts.
- Familiarity with GCP IAM, monitoring tools, and cost optimization strategies.
- Experience with Git, JIRA, and Agile methodologies.
- Excellent problem-solving and communication skills.
Thanks& Regards
📌 GCP Data Engineer(Immediate Joiners Only) (Pune)
🏢 LanceSoft
📍 Pune