Job Description

We are seeking a highly skilled Senior Data Engineer to architect, build, secure, and optimize end-to-end data pipelines and enterprise-grade data platforms. The ideal candidate brings deep expertise in Python, Snowflake, contemporary cloud ecosystems, data warehousing design, and DevSecOps-led automation.
You will mentor junior engineers, drive technical decision-making, and lead solutions that improve data quality, performance, and reliability across the organization.

Roles and Responsibilities
Design and optimize scalable ELT/ETL pipelines using Python and SQL.
Build real-time, near-real-time, and batch data frameworks.
Implement CDC, SCD, incremental loads, schema evolution, and orchestration best practices.
Manage Snowflake settings including warehouses, databases, schemas, RBAC, and resource monitors.
Develop event-driven workflows using Snowflake Tasks, Streams, and Snowpipe.
Optimize performance and cost through clustering, caching, micro-partitioning, and warehouse sizing.
Build and maintain cloud-native data solutions using Azure Blob Storage, ADLS, Functions,



ADF, and Purview.
Design Data Warehouses, Data Marts, and Semantic Layers.
Implement Kimball, Data Vault, and contemporary ELT design patterns.
Collaborate with BI and ML teams to operationalize analytics solutions.
Implement CI/CD pipelines using GitHub Actions, Azure DevOps, or GitLab CI.
Enforce DevSecOps practices including secret scanning, dependency scanning, IaC security, and policy-as-code.
Build and manage infrastructure using Terraform, Azure Bicep, or CloudFormation.
Implement data testing, schema validation, and contract enforcement.
Leverage pytest, Great Expectations, dbt tests, and automated profiling.
Develop data quality dashboards, lineage tracking, and SLA monitoring.
Lead design reviews, code reviews, and platform roadmap discussions.
Mentor engineers and drive engineering best practices.
Partner with Product, Data Science, and Business teams to deliver data-driven solutions.

📌 Senior Data Engineer Chennai
🏢 Nielseniq
📍 Chennai