We are seeking a skilled Data Engineer to join our agile team in Karnataka. The ideal candidate will have a strong background in data engineering, with expertise in Azure, Python, PySpark, and SQL. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
Develop and maintain robust data pipelines using Azure services and tools.
Utilize Python and PySpark for data processing and transformation tasks.
Write effective SQL queries to extract and manipulate data from various sources.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
Implement best practices for data governance, security, and compliance.
Monitor and optimize data workflows for performance and reliability.
Stay updated with the latest trends and technologies in data engineering and cloud computing.
Required Skills:
Proficiency in Azure cloud services and data solutions.
Strong programming skills in Python and experience with PySpark.
Solid understanding of SQL and experience with relational databases.
Familiarity with ADB (Azure Databricks) and its integration with data pipelines.
Excellent problem-solving skills and attention to detail.
Ability to work collaboratively in a team environment and communicate effectively.
If you are passionate about data engineering and want to make a significant impact in a rapid-paced environment, we encourage you to apply for this exciting chance.