09 Sep
|
VARITE
|
Hyderabad
Company Name: VARITE India Private Limited
About The Client:
Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.
About The Job:
- Experience: 8 – 10 years
- We are looking for a Senior Data Engineer to design, build, and maintain scalable data pipelines that power analytics and downstream customer systems.
- You will work closely with product, analytics, and platform teams to ingest, process, and transform large volumes of customer, booking, and operational data using contemporary cloudnative data engineering practices.
- This role requires strong hands-on expertise in Python, workflow orchestration, and cloud data platforms, along with the ability to shape robust canonical data models and high-quality metrics.
Essential Job Functions:
Data Pipeline Design & Development
- Design, build, and optimize scalable ETL/ELT pipelines using Python.
- Ingest data from multiple sources including customer, booking,
and operational systems.
- Implement robust data validation, cleansing, and transformation logic.
Workflow Orchestration & Automation
- Use Apache Airflow to schedule, orchestrate, monitor, and manage data workflows.
- Ensure reliability, fault tolerance, and observability of pipelines.
Cloud Data Platform & Storage
- Use Google Cloud Storage (GCS) to manage and store customer data files securely.
- Build and maintain analytics-ready datasets in BigQuery.
- Optimize queries, partitions, and cost-performance trade-offs in BigQuery.
Data Modeling & Transformations
- Develop and maintain modular, version-controlled SQL transformations using dbt.
- Create and manage Canonical Data Models (CDM) to ensure consistency across datasets.
- Define, calculate, and publish standardized business metrics.
Data Delivery & Integration
- Prepare and upload curated datasets and metrics to downstream customer systems.
📌 Senior Data Engineer (Hyderabad)
🏢 VARITE
📍 Hyderabad