13 Aug
|
SteerLean
|
Gurugram
13 Aug
SteerLean
Gurugram
Duties:
- We are looking for a hands-on Data Platform Engineer to support the DCEE Data Insights Platform, a cloud-based data platform enabling secure, high-quality, near real-time reporting, analytics and data product delivery.
- The role requires experience across Kafka ingestion, Snowflake data engineering, dbt transformations, Data Vault 2.0 modelling, Kubernetes/EKS deployments, GitOps, CI/CD, monitoring and production troubleshooting.
- The engineer will support both the Kafka repository for ingestion and connector operations, and the Snowflake repository for data product development, dbt models, masking, grants, streams, tasks and data quality support.
- DIP follows Data Mesh, Event Driven Architecture and Data Vault 2.0 principles with a core stack including Confluent Kafka, Kafka Connectors, EKS, Snowflake, Python, GitHub Actions and ArgoCD.
Skills:
Must have skills: AWS, GitHub, Confluent Kafka Cloud, Kafka ingestion, Snowflake data engineering, dbt transformations, Data Vault 2.0 modelling, Kubernetes/EKS deployments, CI/CD
Other skills:
- Kafka, CDC Ingestion:
Apache Kafka and Confluent Kafka Cloud, Kafka Connect, Debezium CDC, Snowflake Sink Connector, topic/offset management, incremental ingestion, schema change handling.
- Snowflake Data Engineering: Snowflake SQL, databases, schemas, warehouses, roles, grants, Streams, Tasks, Information Schema, RDL/RDV/ID/BDV layer development.
- Dbt, Data Vault Data Products: dbt Core, dbt-snowflake, SQL/YAML models, dbt tests and documentation, custom macros, Data Vault 2.0, Hubs, Links, Satellites and Data Mesh concepts.
- Cloud, Kubernetes DevOps: AWS, EKS, Kubernetes, kubectl, ArgoCD, GitHub, GitHub Actions, CI/CD troubleshooting, Docker/JFrog/SonarQube basics.
- Monitoring Production Support: Splunk, Dynatrace, Tableau alerts, Kafka Connect REST APIs, connector health checks, Snowflake task monitoring, incident troubleshooting and root cause analysis.
- Security, Access Governance: Snowflake masking policie
📌 Data Engineer II (Gurugram)
🏢 SteerLean
📍 Gurugram