Work Location: Chennai, Bangalore, Hyderabad,Pune,Mumbai
Experience: 8+yrs
Required Skills:
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks, PySpark, Python, and SQL.
- Develop batch and streaming data processing solutions using Apache Spark/PySpark.
- Implement data ingestion, transformation, cleansing, validation, and aggregation processes.
- Develop and optimize Databricks notebooks, jobs, workflows, clusters, and Delta Lake solutions.
- Work with AWS data services such as S3, Glue, Lambda, Redshift, Athena, EMR, IAM, and CloudWatch.
- Develop and manage data integration pipelines using Azure Data Factory (ADF) where required in hybrid/multi-cloud environments.
- Build and manage workflow orchestration using Apache Airflow.
Thanks & Regards
SUganya R
[email protected]
📌 AWS Data Engineer - Chennai, Bangalore, Hyderabad,Pune,Mumbai!
🏢 SP Staffing
📍 Hyderabad