5+ years of experience in a Data Engineering role on cloud environment
Must have good experience in Scala/PySpark (preferably on data-bricks environment)
Extensive experience with Transact-SQL.
Experience in Data-bricks/Spark.
Strong experience in Dataware house projects
Expertise in database development projects with ETL processes.
Manage and maintain data engineering pipelines
Develop batch processing, streaming and integration solutions
Experienced in building and operationalizing large-scale enterprise data solutions and applications
Using one or more of Azure data and analytics services in combination with custom solutions
Azure Data Lake, Azure SQL DW (Synapse), and SQL Database products or equivalent products from other cloud services providers
In-depth understanding of data management (e. g. permissions, security, and monitoring).
Cloud repositories for e.g. Azure GitHub, Git




Experience in an agile setting (Prefer Azure DevOps).

Positive to have
Manage source data access security
Automate Azure Data Factory pipelines
Continuous Integration/Continuous deployment (CICD) pipelines, Source Repositories
Experience in implementing and maintaining CICD pipelines
Power BI understanding, Delta Lake house architecture
Knowledge of software development best practices.
Excellent analytical and organization skills.
Effective working in a team as well as working independently.
Robust written and verbal communication skills.
Expertise in database development projects and ETL processes.

Skills:- Scala, PySpark, Spark, SQL Azure, Data Warehouse (DWH) and Apache Synapse

📌 Data Engineer Pune
🏢 GradMener Technology
📍 Pune