31 Jul
|
Saaki Argus And Averil Consulting
|
India
31 Jul
Saaki Argus And Averil Consulting
India
Job Title : Data Engineer
Experience : 6-10 Years
Location: India - Remote
Job Summary
- We are looking for an experienced Data Engineer with 6–10 years of experience to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong expertise in Databricks, Apache Spark, Delta Lake, and contemporary data engineering practices, along with hands-on experience in building reliable batch and real-time data processing solutions.
Key Responsibilities
- Design, develop, and maintain scalable batch and real-time data pipelines using Databricks and Apache Spark.
- Build and optimize ETL/ELT data pipelines to process structured and unstructured data from multiple sources.
- Implement data solutions using Delta Lake and the Medallion Architecture (Bronze, Silver, Gold).
- Develop and maintain Change Data Capture (CDC) and Change Data Feed (CDF)
pipelines for incremental data processing.
- Strong hands on experience in Kafka
- Orchestrate and monitor workflows using Databricks Workflows or equivalent orchestration tools.
- Integrate data from APIs, databases, streaming platforms, and SaaS applications.
- • Ensure data quality, governance, lineage, observability, security, and compliance across the data platform.
- Optimize Spark workloads for performance, scalability, and cloud cost efficiency.
- Collaborate with data architects, analytics teams, and business stakeholders to deliver high-quality data solutions.
- Stay current with emerging Databricks features and best practices, including AI-powered capabilities.
Qualification: Bachelor's Degree
📌 Data Engineer (India)
🏢 Saaki Argus And Averil Consulting
📍 India