21 Aug
|
bootup nexware private
|
India
21 Aug
bootup nexware private
India
Azure Databricks Engineer
Experience: 5+ Years
Location: Hybrid / Hyderabad Only
Employment Type: Full-Time
Application Form: https://forms.gle/uiZxCzM4LmkcBZCD6
Job Summary
We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in developing scalable data pipelines and data engineering solutions using Azure Databricks, PySpark, Python, and SQL.
Key Responsibilities
- Develop and maintain scalable data pipelines using Azure Databricks and PySpark.
- Design and implement ETL/ELT workflows for large-scale data processing.
- Build data solutions using Delta Lake, Azure Data Lake Storage (ADLS), and Azure Data Factory (ADF).
- Perform data transformation, cleansing, aggregation, and optimization using PySpark and Spark SQL.
- Develop and optimize Databricks notebooks, jobs, workflows, and clusters.
- Implement data ingestion from various sources and formats including CSV, JSON, Parquet, and Delta.
- Troubleshoot and optimize data pipelines for performance, reliability, and scalability.
- Collaborate with data engineers, architects,
and business teams to deliver data solutions.
- Follow best practices for Git, version control, deployment, and data security.
Required Skills
- 5+ years of experience in Data Engineering.
- Solid hands-on experience with Azure Databricks and PySpark.
- Strong proficiency in Python and SQL.
- Experience with Azure Data Factory (ADF) and ADLS.
- Strong understanding of ETL/ELT and data pipeline development.
- Experience with Delta Lake and Spark SQL.
- Good knowledge of data warehousing concepts.
- Experience with Git and CI/CD is preferred.
- Strong analytical and problem-solving skills.
Good to Have
- Experience with Snowflake.
- Knowledge of Kafka / Spark Structured Streaming.
- Experience with Azure DevOps.
- Microsoft Azure Data Engineer certification.
Notice Period: Immediate Joiners Preferred
Pay: From ₹1,000,000.00 per year
Work Location: Hybrid remote in Hyderabad, Telangana (Hyderabad, Hyderabad District)
📌 Software Engineer (India)
🏢 bootup nexware private
📍 India