At least 2 years of proven experience as a
Data Engineer
or similar role dealing with
data and ETL
processes.
· Strong knowledge of
Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen
2.
· Experience utilizing
SQL DML
to query modern
RDBMS
in an efficient manner (e.g.,
SQL Server, PostgreSQL
).
· Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
· Experience with
big data technologies
(e.g., Spark).
· Solid problem-solving skills and attention to detail.
· Excellent communication and collaboration skills.
Preferred Qualifications:
· Learning agility
· Technical Leadership
· Consulting and managing business needs
· Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc is accepted.
· Experience building spark applications utilizing PySpark.
· Experience with file formats such as Parquet, Delta, Avro.
· Experience efficiently querying API endpoints as a data source.
· Understanding of the Azure setting and related services such as subscriptions, resource groups, etc.
· Understanding of Git workflows in software development.
· Using Azure DevOps pipeline and repositories to deploy and maintain solutions.
· Understanding of Ansible and how to use it in Azure DevOps pipelines
DM Resume @
[email protected]
📌 Azure Data Engineer || Python Must || 8+ Yrs || Bengaluru
🏢 Innova ESI
📍 Bengaluru