15 Sep
|
Talentmatics
|
Alibag
15 Sep
Talentmatics
Alibag
Job DescriptionWe are hiring Senior FDE professionals with strong expertise in Databricks, Apache Spark, Data Engineering, Cloud, Data Migration and GenAI/RAG.
NRequired Skills:
N
- n
- 10+ years overallexperience with 7+ years in Data Engineering. N
- Robust hands-on experience with Databricks. N
- Strong expertise in Apache Spark, PySpark & Spark SQL. N
- Hands-on experience with Data Migration / Cloud Migration / Data Modernization. N
- Strong Data Architecture / Solution Architecture experience. N
- Experience with AWS, Azure or GCP. N
- Strong understanding ofDelta Lake & Unity Catalog. N
- Experience with batch &streaming; data processing. N
- Strong Python/PySpark coding skills. N
- Experience with CI/CD and DevOps. N
- Exposure to GenAI, LLM,RAG and MLOps/MLflow. N
- Strong production troubleshooting, debugging and RCA skills. N
- Customer-facing experience with strong stakeholder communication and technical solutioning. N
nKey Responsibilities :
N
- n
- Design and implement scalable Databricks & Spark-based data solutions. N
- Lead data migration andmodernization initiatives. N
- Design enterprise Lakehouse and data architectures. N
- Develop production-grade data pipelines and integrations. N
- Optimize Spark workloads and troubleshoot complex production issues. N
- Implement batch and streaming data solutions. N
- Work with Unity Catalog, Delta Lake and Databricks ecosystem. N
- Contribute to GenAI/RAGand MLOps solutions. N
- Engage with customers and stakeholders to understand requirements and provide technical solutions. N
- Drive architecture discussions, technical design and end-to-end implementation. N
📌 Senior Data Engineer (Alibag)
🏢 Talentmatics
📍 Alibag