29 Aug
|
Saicon
|
Karnataka
Role Summary A well-established enterprise organization is seeking a Senior Data Engineer to design, build, and support cloud-based data solutions. The role will focus on developing production-grade pipelines and transformations in Azure Databricks while helping modernize a legacy data warehouse environment. The engineer will work closely with business and technical stakeholders to translate requirements into reliable, scalable, and maintainable solutions.
What You Will Do
- Partner with business users and technical teams to understand requirements and deliver end-to-end data solutions.
- Design, develop, test, deploy, and support data pipelines and analytics-ready datasets using Azure Databricks.
- Build reusable ETL/ELT frameworks and transformations with Python and PySpark.
- Develop complex T-SQL queries and stored procedures and improve database performance.
- Support selected legacy integration, reporting, and production workloads during platform modernization.
- Apply modern lakehouse patterns, data governance, orchestration, and deployment practices.
- Collaborate with the broader data team, take ownership of results, and contribute to continuous improvement.
- Stay current with evolving Databricks, Azure, and cloud data-engineering capabilities.
Required Qualifications
- Bachelor's degree in computer science, engineering, information systems, or a related field, or equivalent practical experience.
- 8+ years of data-engineering experience building enterprise data pipelines with tools such as SSIS or Azure Data Factory.
- 3+ years of hands-on Azure Databricks experience developing production data pipelines.
- 3+ years of Python and PySpark experience supporting production transformations and data-processing workloads.
- Hands-on experience with Delta Lake and Azure Data Lake Storage Gen2.
- Working knowledge of lakehouse and medallion architecture patterns, data catalog/governance concepts, managed pipeline frameworks, workflow orchestration, and Databricks SQL.
- 3+ years of experience with Azure cloud services and automated build/deployment pipelines.
- Solid T-SQL development, troubleshooting, and performance-tuning skills.
- Strong communication, collaboration, ownership, and problem-solving skills.
Preferred Qualifications
- Databricks certification.
- Power BI experience.
- Experience working in an Agile delivery environment.
- Experience handling complex or regulated enterprise data.
- Azure Data Factory experience.
- Database administration exposure.
- Experience with work-management and DevOps platforms.
Work Profile
- Senior individual contributor; no direct reports.
- Primary emphasis: Databricks development and cloud data-platform modernization.
- Secondary emphasis: SQL optimization, legacy pipeline support, ad hoc data requests, and production support.
📌 Senior Data Engineer - Databricks (Karnataka)
🏢 Saicon
📍 Karnataka