19 Sep
|
Quess IT Solutions
|
Bengaluru
19 Sep
Quess IT Solutions
Bengaluru
About the Role:
We're looking for a Senior Data Engineer with robust hands-on expertise in Databricks and the Azure data ecosystem to join our team. You'll play a key role in designing and building scalable data pipelines, working closely with our onsite team to understand and deliver end-to-end data requirements.
What You'll Do:
Collaborate with the onsite team to gather, understand, and translate end-to-end business and technical requirements
Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Python
Work across Azure services including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Blob Storage, and Key Vault for secure and effective data integration
Build and manage data ingestion workflows, connectors, and integration frameworks across multiple source systems
Write and optimize complex SQL queries, with a strong focus on performance tuning
Apply data architecture and data warehousing (DWH) best practices to ensure robust, well-structured solutions
Partner with stakeholders across teams to ensure alignment on data solutions and timely delivery
What We're Looking For:
5+ years of hands-on experience with Databricks
Solid development experience in PySpark and Python
Solid working knowledge of Azure Cloud Services (ADF, ADLS, Blob Storage, Key Vault, etc.)
Experience with data ingestion, connectors, and integration frameworks
Strong SQL skills with a proven track record in performance tuning
Experience designing and delivering scalable data pipelines
Good understanding of data architecture and DWH concepts
Strong communication skills and the ability to manage stakeholders effectively
📌 Azure Data Engineer 5 Days Wfo Bangalore Bengaluru
🏢 Quess IT Solutions
📍 Bengaluru