Senior Databricks Data Engineer
About the Role
We are seeking an experiencedMicrosoft Power Platform Solution Architect & Developer
NYC

to join our growing data and analytics team. This role is ideal for a highly skilled data professional with deep expertise in Databricks, Spark, Kafka, Python, and cloud technologies who can design, build, and optimize enterprise-scale data platforms and real-time data processing solutions.
The successful candidate will bring solid hands-on experience in modern data engineering, distributed computing, cloud-native architectures, and large-scale data integrations.

Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Python.
- Build, optimize, and support high-performance Apache Spark applications for batch and real-time data processing.
- Develop and manage Kafka-based streaming solutions for real-time data ingestion and processing.
- Design and implement data architectures leveraging Delta Lake and open table formats.
- Deploy, monitor, and manage data solutions across Azure and/or AWS cloud platforms.




- Develop and maintain integrations with SQL and NoSQL databases.
- Partner with data architects, developers, business stakeholders, and cross-functional teams to deliver scalable data solutions.
- Implement data quality, governance, security, and performance optimization best practices.
- Contribute to the design and development of microservices-based architectures supporting modern data platforms.
- Work within containerized environments using Kubernetes (K8S) and cloud-native technologies.

Required Qualifications
- 10+ years of experience in Data Engineering, Data Platform Development, or a related field.
- Strong hands-on experience with Databricks and Delta Lake.
- Deep expertise in:
- Apache Spark
- Apache Kafka
- Python
- SQL and NoSQL databases
- Open table formats and modern data lake architectures
- Experience with Azure and/or AWS cloud platforms.
- Strong knowledge of Java d

📌 Senior Databricks Data Engineer (Bengaluru)
🏢 Matrix Global
📍 Bengaluru