We are seeking a skilled Data Engineer to join our dynamic team in Karnataka or Maharashtra. The ideal candidate will have a strong background in data engineering and be proficient in utilizing tools such as PySpark and Azure Databricks. This role is crucial for building and maintaining our data infrastructure, ensuring that our data pipelines are efficient, reliable, and scalable.
Key Responsibilities
- Design, develop, and maintain robust data pipelines using PySpark and Azure Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Implement data storage solutions using Azure Data Lake Storage (ADLS) and ensure data integrity and security.
- Write complex SQL queries to extract, transform, and load data from various sources.
- Monitor and optimize data workflows for performance and reliability.
- Troubleshoot and resolve data-related issues in a timely manner.
- Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives.
Required Skills
- Strong experience in data engineering principles and practices.
- Proficiency in PySpark and Azure Databricks.
- Experience with Azure Data Lake Storage (ADLS).
- Solid understanding of SQL and experience in writing complex queries.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Strong problem-solving skills and attention to detail. If you are passionate about data and eager to work in a fast-paced environment, we encourage you to apply for this exciting prospect to make a significant impact on our data strategy.
Industry
BPO / Call Center
Department
Content Development
📌 Data Engineer (Bengaluru)
🏢 Stalwart Management Consulting
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.