11 Sep
|
Quess
|
Bengaluru
About the Role:
We're looking for a Senior Data Engineer with strong hands-on expertise in Databricks and the Azure data ecosystem to join our team. You'll play a key role in designing and building scalable data pipelines, working closely with our onsite team to understand and deliver end-to-end data requirements.
What You'll Do:
- Collaborate with the onsite team to gather, understand, and translate end-to-end business and technical requirements
- Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Python
- Work across Azure services including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Blob Storage, and Key Vault for secure and efficient data integration
- Build and manage data ingestion workflows, connectors, and integration frameworks across multiple source systems
- Write and optimize complex SQL queries, with a strong focus on performance tuning
- Apply data architecture and data warehousing (DWH) best practices to ensure robust, well-structured solutions
- Partner with stakeholders across teams to ensure alignment on data solutions and timely delivery
What We're Looking For:
- 5+ years of hands-on experience with Databricks
- Robust development experience in PySpark and Python
- Solid working knowledge of Azure Cloud Services (ADF, ADLS, Blob Storage, Key Vault, etc.)
- Experience with data ingestion, connectors, and integration frameworks
- Strong SQL skills with a proven track record in performance tuning
- Experience designing and delivering scalable data pipelines
- Good understanding of data architecture and DWH concepts
- Strong communication skills and the ability to manage stakeholders effectively
📌 Azure Data Engineer - 5 DAYS WFO - Bangalore (Bengaluru)
🏢 Quess
📍 Bengaluru