Job Description

Job purpose

The Data Engineer will design, construct, and maintain scalable data management systems using Azure Databricks. This role

involves supervising the upkeep of existing data infrastructure workflows and creating data processing pipelines utilizing

Databricks Notebooks, Spark SQL, Python, and other Databricks tools. The Senior Data Engineer will oversee and lead the

module through planning, estimation, implementation, monitoring, and tracking.

Key responsibilities
- 5-7 years of experience in software development with a focus on data projects using Python, PySpark, and associated

frameworks.
- Proven experience as a Data Engineer with experience in Azure cloud.
- Experience implementing solutions using Azure cloud services, Azure Data Factory, Azure Lake Gen 2, Azure Databases,

Azure Data Fabric, API Gateway management, Azure Functions.
- Strong SQL skills with RDMS or NoSQL databases.
- Experience with developing APIs using FastAPI or similar frameworks in Python.
- Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes.




- Positive understanding of ETL/ELT processes.
- Experience in the financial services industry, financial instruments, asset classes, and market data are a plus.
- Assist stakeholders with data-related technical issues and support their data infrastructure needs.
- Develop and maintain documentation for data pipeline architecture, development processes, and data governance.
- In-depth knowledge of data warehousing concepts, architecture, and implementation.
- Extremely strong organizational and analytical skills with strong attention to detail.
- Strong track record of excellent results delivered to internal and external clients.
- Excellent problem-solving skills, with the ability to work independently or as part of a team.
- Strong communication and interpersonal skills, with the ability to effectively engage with both technical and non-technical

stakeholders.
- Able to work independently without

📌 Senior Associate (Bengaluru)
🏢 Acuity Knowledge Partners
📍 Bengaluru