16 Sep
|
Talentmatics
|
Alibag
16 Sep
Talentmatics
Alibag
Job DescriptionWe are hiring Senior FDE professionals with strong expertise in Databricks, Apache Spark, Data Engineering, Cloud, Data Migration and GenAI/RAG.
NRequired Skills:
N
n
- 10+ years overallexperience with 7+ years in Data Engineering.
N
- Strong hands-on experience with Databricks.
N
- Strong expertise in Apache Spark, PySpark & Spark SQL.
N
- Hands-on experience with Data Migration / Cloud Migration / Data Modernization.
N
- Strong Data Architecture / Solution Architecture experience.
N
- Experience with AWS, Azure or GCP.
N
- Strong understanding ofDelta Lake & Unity Catalog.
N
- Experience with batch &streaming; data processing.
N
- Strong Python/PySpark coding skills.
N
- Experience with CI/CD and DevOps.
N
- Exposure to GenAI, LLM,RAG and MLOps/MLflow.
N
- Strong production troubleshooting, debugging and RCA skills.
N
- Customer-facing experience with solid stakeholder communication and technical solutioning.
N
nKey Responsibilities :
N
n
- Design and implement scalable Databricks & Spark-based data solutions.
N
- Lead data migration andmodernization initiatives.
N
- Design enterprise Lakehouse and data architectures.
N
- Develop production-grade data pipelines and integrations.
N
- Optimize Spark workloads and troubleshoot complex production issues.
N
- Implement batch and streaming data solutions.
N
- Work with Unity Catalog, Delta Lake and Databricks ecosystem.
N
- Contribute to GenAI/RAGand MLOps solutions.
N
- Engage with customers and stakeholders to understand requirements and provide technical solutions.
N
- Drive architecture discussions, technical design and end-to-end implementation.
N
📌 Senior Data Engineer (Alibag)
🏢 Talentmatics
📍 Alibag