Project Description: We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using up-to-date cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.
Responsibilities: Key Responsibilities • Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
- Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
- Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
- Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
- Automate data ingestion, transformation,
and operational processes using Python, Pandas, and PySpark.
- Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
- Establish data quality, governance, monitoring, and CI/CD best practices.
- Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
- Create and maintain technical documentation, deployment procedures, and operational runbooks.
Mandatory Skills Description: Mandatory Skills • Snowflake Data Warehouse • Azure Data Factory (ADF) • DBT • Python • Advanced SQL • Data Modeling (3NF, Star Schema, Snowflake Schema) • Apache Airflow / Prefect / Dagster • Cloud Platforms (Azure preferred) • Git and CI/CD • Data Quality and Governance Frameworks • Agile/Scrum Methodology
📌 Senior Data Engineer (immediate joiner) (India)
🏢 Luxoft
📍 India