About The Role

As a Data Engineer in the Edge of Technology Center, you will play a critical role in designing and implementing scalable data infrastructure to power advanced analytics, AI/ML, and business intelligence. This position demands a hands-on technologist who can architect reliable pipelines, manage real-time event streams, and ensure smooth data operations across cloud-native environments. You will work closely with cross-functional teams to enable data-driven decisionmaking and innovation across the organization.

Key Responsibilities

Design, implement, and maintain robust ETL/ELT pipelines using tools like Argo Workflows or Apache Airflow.

Manage and execute database schema changes with Alembic or Liquibase, ensuring data consistency.

Configure and optimize distributed query engines like Trino and AWS Athena for analytics.

Deploy and manage containerized workloads on AWS EKS or GCP GKE using Docker, Helmfile, and Argo CD.

Build data lakes/warehouses on AWS S3 and implement performant storage using Apache Iceberg.





Use Terraform and other IaC tools to automate cloud infrastructure provisioning securely.

Develop CI/CD pipelines with GitHub Actions to support rapid and reliable deployments.

Architect and maintain Kafka-based real-time event-driven systems using Apicuro and AVRO.

Collaborate with product, analytics, and engineering teams to define and deliver data solutions.

Monitor and troubleshoot data systems for performance and reliability issues using observability tools (e.g., Prometheus, Grafana).

Document data flows and maintain technical documentation to support scalability and knowledge sharing.

Key Deliverables

Fully operational ETL/ELT pipelines supporting high-volume, low-latency data processing.

Zero-downtime schema migrations with consistent performance across environments.

Distributed query engines tuned for large-scale analytics with minimal response time.

Reliable containerized deployments in Kubernetes using GitOps methodo

📌 Data Engineer Junior (India)
🏢 Encardio Rite
📍 India