Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.
Develop and manage data integration solutions using Azure Data Factory (ADF).
Collaborate with data analysts, business stakeholders, and cross-functional teams to understand data requirements.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Ensure data quality, governance, and security across data platforms.
Troubleshoot and resolve data pipeline issues while ensuring high availability.
Required Skills
Robust hands-on experience with PySpark.
Experience working with Databricks for data engineering and analytics.
Hands-on experience with Azure Data Factory (ADF).
Solid knowledge of SQL and data warehousing concepts.
Valuable understanding of Azure cloud services and ETL processes.
Experience with performance tuning and optimization of Spark jobs.
Excellent analytical, problem-solving, and communication skills.
Good to Have
Experience with Power BI for reporting and dashboard development.
Knowledge of Azure Data Lake, Delta Lake, or Synapse Analytics.
Familiarity with CI/CD pipelines and version control tools such as Git.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
📌 Azure Data Engineer Bengaluru
🏢 Ascendion Engineering
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.