We are looking for a Senior Databricks Engineer. The primary focus of this role is built in Python, while also leading the migration to Azure Databricks to improve performance, scalability, and efficiency. This role involves developing, optimizing, and automating reporting processes using PySpark and SQL, ensuring accurate and timely regulatory report generation. This is an exciting prospect to work on.
Responsibilities
Implement high-quality solutions that address business needs and adhere to industry standards
Drive automation of manual processes to the next level
Closely collaborate within an agile team and a global agile organization
Translate high-level business requirements into technical requirements addressing reliability, scalability, and performance needs
Skills
Must have
Minimum of 4+ years of experience developing enterprise Databricks applications.
Hands-on experience with Databricks ETL/data-loading mechanisms using Databricks Jobs,
including relevant performance tuning and optimisation.
Ability to independently understand business requirements and translate them into productive, high-performing Databricks implementations.
Data modelling experience would be an added advantage.
Experience with Databricks deployments using Databricks Asset Bundles (DAB) would be an added advantage.
Excellent communication skills.
Nice to have
Azure Data Services
ETL Data Processing
Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking setting.
Data Modeling, metadata management
Git, GitHub, GitLab
Jenkins
Regulatory compliance knowledge: Basel, MiFID, GDPR
Big Data
Cloud security and access controls (IAM, RBAC)
Familiarity with Docker, Kubernetes, Apache
Other
Languages
English: C1 Advanced
Seniority
Senior
📌 Senior Databricks Engineer With Python Pune (India)
🏢 Luxoft
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.