Budget : 5 to 10 yrs - 28 LPA , 10+ Yrs - 35 LPA

Hybrid – 3 Days / week work or 12 Days / Month from Any Xebia Office

Shift Timings - 2 to 11 pm - IST
Key Core Skills - Python, Pyspark, SQL, GCP, DBT
JD:
We have 1000 + Data Pipeline that is using Databricks Cluster to perform the Data Transformation(Raw-->Silver-->Gold) and orchestrated using Airflow. Both Databricks and Airflow are powered using GCP Platform. The Curated Datasets are exposed to the end users using Databricks Notebook Interface and Big query. In the future, we want to migrate to a framework that will use GCP Cloud Native tools that can effectively run Spark Workloads. We will need to understand the current landscape well and chalk out a plan to migrate the workloads to the recent Framework based approach.

Key Responsibilities: We are seeking a highly skilled and experienced Engineer to help us with the design and implementation of Future GCP Native Data Processing Framework. The ideal candidate will have extensive experience building scalable data solutions, solid analytical skills,



and a passion for leveraging GCP Services to develop Tools and Framework to support Data Engineering Teams.
Help with the design and implementation of the of the Data Processing Framework that leverages GCP Cloud Native Services.
Ensure data integrity, consistency, and availability across all data systems.
Develop documentation and standards for data processes and procedures.
Experience:
Minimum of 10+ years of experience in data engineering, with a focus on data architecture and pipeline development.
Proven experience with Cloud platforms (GCP) and big data technologies (e.g., PySpark, Databricks, Big Query, GCP Services)
Proven experience with Orchestration Solutions (e.g., Airflow,Dagster, Comparable GCP Services).
Understanding of Data Lake Table Formats like Delta, Iceberg.
Skills:
Proficiency in programming languages such as Python
Familiarity with data lake architectures and best practices.
Solid problem-solving skills and attention to detail.
Excellent communication and collaboration

📌 Data Engineer Gurugram
🏢 Important Group
📍 Gurugram