24 Sep
|
ENTERPRISE
|
Hyderabad
24 Sep
ENTERPRISE
Hyderabad
Azure Data Engineer
Key Responsibilities
- Design, develop, and deploy scalable data processing pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Collaborate with cross-functional teams to identify business requirements and architect data solutions that meet those needs.
- Develop and maintain data warehouses, data marts, and data lakes on Azure platforms.
- Ensure data quality, security, and compliance by implementing data governance policies and procedures.
- Analyze and optimize data processing workloads to improve performance and reduce costs.
- Provide technical guidance and training to junior team members on Azure data engineering best practices.
Required Qualifications
- 5+ years of experience in data engineering, with a focus on Azure data services.
- Proven expertise in designing, developing, and deploying scalable data processing pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Strong understanding of data warehousing, data marts, and data lakes on Azure platforms.
- Experience with data governance, data quality, and data security.
- Ability to analyze and optimize data processing workloads to improve performance and reduce costs.
- Bachelor's degree in Computer Science or related field.
Technical Skills & Experience
- Expert-level knowledge of Azure data services,
including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Strong programming skills in Python, with experience using libraries such as pandas, NumPy, and scikit-learn.
- Experience with big data processing frameworks, such as Apache Spark and Hadoop.
- Knowledge of data warehousing, data marts, and data lakes on Azure platforms.
- Experience with cloud-based data storage solutions, such as Azure Blob Storage and Azure Data Lake Storage.
- Strong understanding of data governance, data quality, and data security.
Preferred Qualifications
- Experience with Python programming language.
- Familiarity with cloud-based development tools, such as Azure DevOps and GitHub.
- Knowledge of DevOps practices, including continuous integration and continuous deployment.
- Experience with agile development methodologies, such as Scrum and Kanban.
- Strong communication and interpersonal skills, with the ability to work effectively with cross-functional teams.
The successful candidate will be a robust problem-solver with excellent analytical and technical skills. They will have a proven track record of delivering high-quality data engineering solutions in an Azure-based environment.
This is a contract position based in Hyderabad, India.
📌 azure data engineer (Hyderabad)
🏢 ENTERPRISE
📍 Hyderabad