14 Sep
|
Talentmatics
|
Maharashtra
14 Sep
Talentmatics
Maharashtra
We are hiring Senior FDE professionals with strong expertise in Databricks, Apache Spark, Data Engineering, Cloud, Data Migration and Gen AI/RAG.
Required Skills :
10+ years overall experience with 7+ years in Data Engineering. Strong hands-on experience with Databricks. Strong expertise in Apache Spark, Py Spark & Spark SQL. Hands-on experience with Data Migration / Cloud Migration / Data Modernization. Solid Data Architecture / Solution Architecture experience. Experience with AWS, Azure or GCP. Strong understanding of Delta Lake & Unity Catalog. Experience with batch & streaming data processing. Strong Python/Py Spark coding skills. Experience with CI/CD and Dev Ops. Exposure to Gen AI, LLM, RAG and MLOps/MLflow. Strong production troubleshooting, debugging and RCA skills. Customer-facing experience with strong stakeholder communication and technical solutioning.
Key Responsibilities :
Design and implement scalable Databricks & Spark-based data solutions. Lead data migration and modernization initiatives. Design enterprise Lakehouse and data architectures. Develop production-grade data pipelines and integrations. Optimize Spark workloads and troubleshoot complex production issues. Implement batch and streaming data solutions. Work with Unity Catalog, Delta Lake and Databricks ecosystem. Contribute to Gen AI/RAG and MLOps solutions. Engage with customers and stakeholders to understand requirements and provide technical solutions. Drive architecture discussions, technical design and end-to-end implementation.
📌 Senior Data Engineer (Maharashtra)
🏢 Talentmatics
📍 Maharashtra