08 Nov
|
Wildnet Technologies
|
Noida
08 Nov
Wildnet Technologies
Noida
Role & responsibilities
Role: Data Engineer / Senior Data Engineer
Role Overview
We are looking for an experienced Data Engineer to build and manage production-grade data pipelines on AWS, with a robust focus on data quality, data privacy, governance, and scalable data processing.
Key Responsibilities
Build and maintain data pipelines from transactional systems and AWS.
Develop and test data de-identification and privacy transformations at the column level.
Manage orchestration, scheduling, retries, backfills, monitoring, alerting, and data-quality checks.
Contribute to CI/CD and infrastructure as code.
Maintain data catalogs, lineage, and technical documentation.
Support production pipelines and troubleshoot schema changes and data drift.
For senior candidates, mentor engineers and take end-to-end ownership of systems, including on-call responsibilities.
Required Skills
Strong Python and SQL skills, with hands-on experience in Spark or distributed processing.
Experience building and operating production data pipelines on AWS.
Familiarity with Airflow, Dagster, AWS Step Functions, or similar orchestration tools.
Solid software engineering practices, including Git, code reviews, automated testing, idempotency, and backfills.
Experience in production support, troubleshooting, and data-quality management.
Valuable to Have
AWS DMS or other CDC technologies.
Data masking, tokenization, or privacy tools.
dbt or similar transformation frameworks.
Core Skills: Data Engineering, Python, SQL, AWS, Spark, ETL/ELT, Data Pipelines, Airflow, Data Quality, Data Privacy, CI/CD, and Infrastructure as Code.
Preferred candidate profile
Core Skills: Data Engineering, Python, SQL, AWS, Spark, ETL/ELT, Data Pipelines, Airflow, Data Quality, Data Privacy, CI/CD, and Infrastructure as Code.
📌 Data Engineer Noida
🏢 Wildnet Technologies
📍 Noida