Data Engineer (Bengaluru)

Data Engineer (Bengaluru)

20 Nov
|
RARR Technologies
|
Bengaluru

20 Nov

RARR Technologies

Bengaluru

Key Responsibilities

- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, and Microsoft Fabric.
- Use Azure storage services to organize and maintain pipeline outputs, including Azure Data Lake Storage Gen2 and Azure Blob Storage.
- Collaborate with data scientists, analysts, architects, and other stakeholders to understand requirements and deliver high-quality data solutions.
- Optimize Azure data pipelines for performance, scalability, and reliability.
- Ensure data quality and integrity through validation techniques and frameworks.
- Document data processes, configurations, and best practices.
- Monitor and troubleshoot pipeline issues, ensuring timely resolution.
- Stay current with industry trends and emerging technologies.
- Manage the CI/CD process for deploying and maintaining data solutions.

Required Qualifications

- Bachelor s degree in Computer Science, Engineering, or a related field, or equivalent experience, with strong programming fundamentals.
- 5-8 years of total experience, including at least 3 years as a Data Engineer or in a similar role involving data and ETL processes.
- Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage, and Azure Data Lake Storage Gen2.
- Experience using SQL DML to query relational databases efficiently, such as SQL Server or PostgreSQL.
- Strong understanding of software engineering principles applied to data engineering, including CI/CD, version control, and testing.




- Experience with big data technologies such as Apache Spark.
- Robust problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.

Preferred Qualifications

- Learning agility, technical leadership, and experience consulting on and managing business needs.
- Strong experience with Python; experience with Scala, Java, C, or another programming language is also accepted.
- Experience building Spark applications using PySpark.
- Experience with file formats such as Parquet, Delta, and Avro.
- Experience querying API endpoints as data sources.
- Understanding of Azure subscriptions, resource groups, and related services.
- Understanding of Git workflows and experience using Azure DevOps pipelines and repositories to deploy and maintain solutions.
- Understanding of Ansible and its use in Azure DevOps pipelines.

Top Mandatory Skills

1. Deep working knowledge of Azure Databricks.
2. Solid SQL skills, proficiency in a core programming language such as Python, Scala, or Java, and practical experience implementing advanced Spark.
3. Implementation knowledge of end-to-end ETL/ELT processes across different source systems and data formats.

Good-to-Have Skills

1. Stakeholder management skills or exposure to stakeholder management.
2. Exposure to full DevOps practices and test automation.
3. Strong debugging skills.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer (Bengaluru)
🏢 RARR Technologies
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (bengaluru) / bengaluru