Coherent Pixel Systems is Hiring!

Consultant – Data Engineer (Azure, Snowflake, dbt)

Experience: 6–12 Years

Location: Chennai, India

Work Mode: Hybrid – 3 Days WFO / Week – DLF, Porur

Shift: 12:00 PM – 9:00 PM IST

We are looking for an experienced Data Engineer responsible for the hands-on development, maintenance, and optimization of robust end-to-end analytics data pipelines.

The role involves working with a contemporary cloud technology stack including Azure, Snowflake, and dbt to ingest and transform data according to Data Vault 2.0 standards, while actively leveraging AI-assisted development tools to improve coding efficiency and delivery speed.

Tools & Technologies

Snowflake | dbt | Azure Data Factory | ADLS | SQL | Python | Git | CI/CD | AI-Assisted Coding Tools

Responsibilities

- Build and maintain scalable, automated data ingestion and processing pipelines using Azure, dbt, and Snowflake.
- Extract data from various source systems and load it into Snowflake for further processing.
- Develop modular and testable SQL transformations using dbt.
- Implement physical Data Vault 2.0 structures, including:
- Hubs
- Links
- Satellites
- Actively use AI coding assistants such as GitHub Copilot / Cursor to:
- Generate boilerplate code
- Write dbt tests
- Draft technical documentation
- Troubleshoot SQL/Python scripts
- Ensure high data quality by developing comprehensive dbt tests and automated data validation checks across the E2E architecture.
- Work closely with the Tech Lead, Data Architect, and Business Analysts in an Agile environment.
- Understand business and technical requirements and deliver reliable datasets for downstream reporting.

Typical Activities




- Write and optimize complex SQL queries and Python scripts for data extraction and transformation.
- Configure Azure Data Factory pipelines and Snowpark Python pipelines for secure and scheduled data movement.
- Develop dbt models, macros, and tests to populate the Snowflake Data Vault.
- Participate in daily Scrum meetings.
- Participate in code reviews with the Tech Lead.
- Troubleshoot and optimize data pipelines and SQL transformations.

Requirements
- 6–12 years of hands-on experience in Data Engineering or Database Development.
- Strong proficiency in writing complex and optimized SQL.
- Solid scripting skills in Python.
- Hands-on experience building pipelines using Microsoft Azure, particularly:
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Practical experience developing and performance-tuning in Snowflake.
- Hands-on experience using dbt for:
- Data transformation
- Testing
- Documentation
- Familiarity with incorporating AI-assisted development tools such as GitHub Copilot into daily coding workflows.
- Understanding of Data Vault 2.0 concepts, including Hubs, Links, and Satellites, and experience populating these structures.

Nice to Have
- Microsoft Certified: Azure Data Engineer Associate
- SnowPro Core Certification
- Experience with CI/CD pipelines using Azure DevOps or GitHub Actions.
- Strong knowledge of Git/version control.
- Exposure to building dimensional models / Star Schemas on top of a Data Vault architecture.

Interested candidates can share their updated resumes. [email protected] [email protected]

Contact / WhatsApp:

(phone hidden) / (phone hidden)

Work Location: In person

📌 Consultant – Data Engineer (Azure, Snowflake, dbt) (Chennai)
🏢 Coherent Pixel Systems
📍 Chennai