10 Sep
|
Ascendion Engineering
|
Bengaluru
10 Sep
Ascendion Engineering
Bengaluru
Data Engineer
Position: Data Engineer
Experience: 3+ Years
Location: Bangalore
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.
Develop and manage data integration solutions using Azure Data Factory (ADF).
Collaborate with data analysts, business stakeholders, and cross-functional teams to understand data requirements.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Ensure data quality, governance, and security across data platforms.
Troubleshoot and resolve data pipeline issues while ensuring high availability.
Required Skills
Robust hands-on experience with PySpark.
Experience working with Databricks for data engineering and analytics.
Hands-on experience with Azure Data Factory (ADF).
Strong knowledge of SQL and data warehousing concepts.
Good understanding of Azure cloud services and ETL processes.
Experience with performance tuning and optimization of Spark jobs.
Excellent analytical, problem-solving, and communication skills.
Data Warehousing concepts (Star Schema, Snowflake Schema, ETL/ELT, Dimensional Modelling)
Experience in designing and developing scalable data pipelines
Robust understanding of data integration, transformation, and optimization techniques
Positive to Have
Experience with Power BI for reporting and dashboard development.
Knowledge of Azure Data Lake, Delta Lake, or Synapse Analytics.
Familiarity with CI/CD pipelines and version control tools such as Git.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
📌 Azure Data Engineer Bengaluru
🏢 Ascendion Engineering
📍 Bengaluru