We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and a passion for working with cutting-edge technologies. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and workflows that support our data analytics and business intelligence initiatives.
You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and actionable.
Key Responsibilities
- Design and implement data pipelines using Microsoft Fabric, Dataflow Gen2, and Azure Data Factory (ADF).
- Develop and maintain data models and structures in Lakehouse environments.
- Utilize Python and PySpark for data processing and transformation tasks.
- Write productive SQL queries to extract and manipulate data from various sources.
- Collaborate with business intelligence teams to integrate data into Power BI dashboards and reports.
- Ensure data quality and integrity throughout the data lifecycle.
- Troubleshoot and optimize data workflows for performance and reliability.
Required Skills
- Proficiency in Microsoft Fabric and its components.
- Experience with Dataflow Gen2 and Lakehouse architecture.
- Strong knowledge of Azure Data Factory (ADF) and data pipeline development.
- Proficient in Python and PySpark for data manipulation and analysis.
- Solid understanding of SQL for database querying and management.
- Familiarity with Power BI and DAX for data visualization.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a fast-paced environment. If you are passionate about data engineering and eager to work with innovative technologies, we encourage you to apply and join our team in Madhya Pradesh or Andhra Pradesh.