In this role, you will design and develop scalable ETL/ELT pipelines using Databricks and Snowflake. You will be responsible for architecting data lakehouse solutions following Medallion architecture and implementing Lambda patterns for batch and real-time processing. The ideal candidate will build and maintain a single source of truth across enterprise platforms while optimizing data models and query performance.

You will collaborate with cross-functional teams to translate business requirements into reliable technical solutions.

Required Skills and Qualifications

- Proficiency in designing and developing ETL/ELT pipelines using Databricks (PySpark/Spark SQL) and Snowflake
- Experience architecting data lakehouse solutions (Bronze, Silver, Gold layers)
- Ability to implement Lambda architecture patterns for batch and real-time data processing




- Skilled in developing data ingestion frameworks from databases, APIs, and streaming platforms
- Experience with orchestration tools such as Airflow, ADF, or Databricks Workflows
- Knowledge of CI/CD practices for data pipelines and infrastructure-as-code
- Familiarity with data quality frameworks and pipeline monitoring.

Roles and Responsibilities

- Experience with Delta Live Tables (DLT) or Unity Catalog
- Knowledge of Informatica, Streamsets, or other industry-standard ETL tools
- Familiarity with data governance and cataloging tools
- Understanding of security and compliance standards in data engineering

📌 Data Engineer (Greater Noida)
🏢 R Systems International
📍 Greater Noida