16 Sep
|
Talentmatics
|
Alibag
16 Sep
Talentmatics
Alibag
Job DescriptionWe are hiring Senior FDE professionals with strong expertise in Databricks, Apache Spark, Data Engineering, Cloud, Data Migration and GenAI/RAG.
NRequired Skills:
N
n
10+ years overallexperience with 7+ years in Data Engineering. N
Robust hands-on experience with Databricks. N
Strong expertise in Apache Spark, PySpark & Spark SQL. N
Hands-on experience with Data Migration / Cloud Migration / Data Modernization. N
Robust Data Architecture / Solution Architecture experience. N
Experience with AWS, Azure or GCP. N
Strong understanding ofDelta Lake & Unity Catalog. N
Experience with batch &streaming; data processing. N
Strong Python/PySpark coding skills. N
Experience with CI/CD and DevOps. N
Exposure to GenAI, LLM,RAG and MLOps/MLflow. N
Strong production troubleshooting, debugging and RCA skills. N
Customer-facing experience with solid stakeholder communication and technical solutioning. N
nKey Responsibilities :
N
n
Design and implement scalable Databricks & Spark-based data solutions. N
Lead data migration andmodernization initiatives. N
Design enterprise Lakehouse and data architectures. N
Develop production-grade data pipelines and integrations. N
Optimize Spark workloads and troubleshoot complex production issues. N
Implement batch and streaming data solutions. N
Work with Unity Catalog, Delta Lake and Databricks ecosystem. N
Contribute to GenAI/RAGand MLOps solutions. N
Engage with customers and stakeholders to understand requirements and provide technical solutions. N
Drive architecture discussions, technical design and end-to-end implementation. N
📌 Senior Data Engineer Alibag
🏢 Talentmatics
📍 Alibag