18 Aug
|
McBird Technologies
|
Bengaluru
18 Aug
McBird Technologies
Bengaluru
We are looking for an experienced Azure Databricks Engineer with strong expertise in cloud data engineering, big data technologies, ETL/ELT, Azure data services, and both cloud and on-premises data environments.
?️ Key Skills & ResponsibilitiesAzure Data Services
- Strong hands-on experience with Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure Blob Storage.
- Experience designing and implementing scalable cloud data pipelines and data processing solutions.
- Experience with Azure compute and storage services, including Azure VMs and Blob Storage.
Databricks & Big Data
- Strong experience with Azure Databricks and Apache Spark.
- Experience with the Hadoop ecosystem, including technologies such as Hive and related platforms.
- Experience with Kafka and distributed data processing is preferred.
- Strong understanding of data ingestion, transformation, processing, and optimization.
ETL / ELT
- Experience designing and implementing ETL/ELT pipelines.
- Hands-on experience with one or more tools such as Apache NiFi, Talend, Informatica, or Apache Airflow.
- Experience working with both batch and large-scale data processing workloads.
Programming & Databases
- Strong programming skills in Python and SQL.
- Knowledge of Java, Scala, or R is an added advantage.
- Strong understanding of data modelling concepts including:
- Star Schema
- Snowflake Schema
- Normalization
- Denormalization
- Fact & Dimension modelling
Cloud Security & Governance
- Understanding of cloud security best practices.
- Experience with Azure AD / Microsoft Entra ID, Azure Key Vault, identity and access management, and secure data handling.
- Experience implementing data governance, data quality, validation, and monitoring.
On-Premises & Hybrid Infrastructure
- Experience working with on-premises infrastructure including Linux/Windows servers, networking, storage, and server management.
- Experience with on-premises cluster technologies such as Cloudera or Hortonworks is preferred.
- Knowledge of security concepts such as firewalls, VPNs, and data encryption is an advantage.
- Experience working in hybrid cloud environments is highly desirable.
? What We're Looking For
- 5–8 years of overall experience in Data Engineering / Big Data / Cloud Data Engineering.
- Strong hands-on experience with Azure Databricks, ADF, ADLS, Spark, Python, and SQL.
- Strong troubleshooting and problem-solving abilities.
- Good understanding of data architecture, data pipelines, and data quality.
- Excellent communication and collaboration skills.
- Ability to work independently in a remote workplace.
📌 Azure Databricks Engineer (Bengaluru)
🏢 McBird Technologies
📍 Bengaluru