07 Nov
|
Wildnet Technologies
|
Noida
07 Nov
Wildnet Technologies
Noida
Role & responsibilities
Role: Data Engineer / Senior Data Engineer
Role Overview
We are looking for an experienced Data Engineer to build and manage production-grade data pipelines on AWS, with a strong focus on data quality, data privacy, governance, and scalable data processing.
Key Responsibilities
- Build and maintain data pipelines from transactional systems and AWS.
- Develop and test data de-identification and privacy transformations at the column level.
- Manage orchestration, scheduling, retries, backfills, monitoring, alerting, and data-quality checks.
- Contribute to CI/CD and infrastructure as code.
- Maintain data catalogs, lineage, and technical documentation.
- Support production pipelines and troubleshoot schema changes and data drift.
- For senior candidates, mentor engineers and take end-to-end ownership of systems, including on-call responsibilities.
Required Skills
- Strong Python and SQL skills, with hands-on experience in Spark or distributed processing.
- Experience building and operating production data pipelines on AWS.
- Familiarity with Airflow, Dagster, AWS Step Functions, or similar orchestration tools.
- Solid software engineering practices, including Git, code reviews, automated testing, idempotency, and backfills.
- Experience in production support, troubleshooting, and data-quality management.
Good to Have
- AWS DMS or other CDC technologies.
- Data masking, tokenization, or privacy tools.
- dbt or similar transformation frameworks.
Core Skills: Data Engineering, Python, SQL, AWS, Spark, ETL/ELT, Data Pipelines, Airflow, Data Quality, Data Privacy, CI/CD, and Infrastructure as Code.
Preferred candidate profile
Core Skills: Data Engineering, Python, SQL, AWS, Spark, ETL/ELT, Data Pipelines, Airflow, Data Quality, Data Privacy, CI/CD, and Infrastructure as Code.
📌 Data Engineer (Noida)
🏢 Wildnet Technologies
📍 Noida