Key Responsibilities

* Design and develop scalable data pipelines using **Azure Data Factory (ADF)** and equivalent AWS services.
* Work with **Data Lakes, Lakehouse architectures, Delta Lake, and Data Warehouses** across cloud platforms.
* Develop efficient data processing solutions using **Apache Spark / PySpark**.
* Build and maintain **Semantic Models** for analytics and reporting.
* Develop and optimize **Advanced SQL** queries, transformations, and data models.
* Work with large-scale formats such as **Parquet** and implement efficient storage and processing strategies.
* Apply **Spark optimization techniques** including partitioning, caching, broadcast joins, shuffle optimization, and query tuning.
* Work with cloud data services such as **Azure Data Lake, Synapse, Fabric, S3, Glue, Athena, Redshift, and EMR**.
* Ensure data quality, performance, scalability, security, and reliability of data pipelines.

### Must Have





* 2–3 years of hands-on **Data Engineering** experience.
* Strong expertise in **Azure Data Factory (ADF)**.
* Strong **Advanced SQL** skills.
* Good hands-on experience with **Apache Spark / PySpark**.
* Strong understanding of **Data Lake, Lakehouse, Delta Lake, and Data Warehouse** concepts.
* Good understanding of **Parquet and columnar data formats**.
* Experience with **Semantic Models / Power BI datasets**.
* Understanding of **ETL/ELT, data modeling, partitioning, and Spark performance optimization**.
* Positive understanding of cloud-based data engineering architectures.

Pay: ₹500,000.00 - ₹700,000.00 per year

Benefits:

- Flexible schedule
- Provident Fund

Experience:

- Azure: 3 years (Required)

Location:

- Ahmedabad, Gujarat 380054 (Required)

Work Location: In person

📌 Jr. data engineer (India)
🏢 SculptSoft
📍 India