Project Description:

We are looking for a Senior Databricks Engineer. The primary focus of this role is built in Python, while also leading the migration to Azure Databricks to improve performance, scalability, and efficiency.

This role involves developing, optimizing, and automating reporting processes using PySpark and SQL, ensuring accurate and timely regulatory report generation. This is an exciting prospect to work on.

Responsibilities:
Implement high-quality solutions that address business needs and adhere to industry standards
Drive automation of manual processes to the next level
Closely collaborate within an agile team and a global agile organization
Translate high-level business requirements into technical requirements addressing reliability, scalability, and performance needs

Mandatory Skills Description:
Minimum 6 years of hands-on application development experience using Databricks with Python
Experience with PySpark, Pandas, NumPy,



and unit testing
Hands-on experience with SQL Server/ PostgreSQL database
Practical experience with microservice architectures, CI/CD pipelines (preferably with GitLab)
Positive to have exposure to cloud native services on Azure Experience in translating high-level business requirements into IT requirements
Excellent communication skills

Nice-to-Have Skills Description:
Azure Data Services
ETL & Data Processing
Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking setting.
Data Modeling, metadata management
Git, GitHub, GitLab
Jenkins
Regulatory compliance knowledge: Basel, MiFID, GDPR
Big Data
Cloud security and access controls (IAM, RBAC)
Familiarity with Docker, Kubernetes, Apache

📌 Databricks Developer With Python Pune
🏢 Luxoft
📍 Pune