Responsibilities
Design and develop scalable data processing solutions using PySpark in Microsoft Fabric.
Build and optimize ETL/ELT pipelines for processing large-scale structured and semi-structured datasets.
Develop data ingestion, transformation, and aggregation workflows using Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
Required Skills:
Hands-on experience in designing and developing scalable data processing solutions using PySpark.
Experience in building and optimizing ETL/ELT pipelines using Spark DataFrames and Spark SQL.
Proficiency in developing data workflows using Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
AditiConsulting
26-04992
Skills: Etl, Pyspark, Spark SQL, ELT
Experience: 0.00-0.00 Years
📌 Digital Specialist 2 (Chennai)
🏢 Cvali
📍 Chennai