Key Responsibilities
Design, develop, and optimize scalable data pipelines using PySpark and SQL.
Build and maintain ETL/ELT workflows for ingesting, transforming, and loading data from multiple sources.
Develop data solutions using the Databricks platform.
Work with cloud services, preferably Microsoft Azure, to implement data engineering solutions.
Optimize data processing performance and ensure data quality, reliability, and governance.
Collaborate with data analysts, data scientists, and business teams to deliver high-quality data products.
Implement best practices for data modeling, data pipeline orchestration, and performance tuning.
Monitor, troubleshoot, and improve existing data pipelines and workflows.
Required Skills
Solid hands-on experience with PySpark and SQL.
Experience developing ETL/ELT pipelines for large-scale data processing.
Hands-on experience with Databricks.
Experience with cloud platforms, preferably Microsoft Azure.
Knowledge of distributed data processing frameworks such as Apache Spark.
Experience working with data lakes, data warehouses, and big data ecosystems.
Understanding of data pipeline orchestration tools.
Solid problem-solving and performance optimization skills.
Preferred Qualifications
Experience with Azure Data Factory or similar orchestration tools.
Knowledge of Delta Lake architecture.
Experience with CI/CD and version control tools like Git.
Familiarity with data governance and data quality frameworks.
Skills
PySpark
SQL
ETL
Databricks
📌 Sr Data Engineer Noida
🏢 Recognized
📍 Noida
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.