11 Sep
|
byval technologies india
|
Gurugram
11 Sep
byval technologies india
Gurugram
Azure Data Engineer
Candidate Skills and Qualifications:
• Experience: 6 to 8+ years as an Azure Data Engineer, with a strong focus on Azure Databricks and PySpark.
• Data Pipeline Development: Proven expertise in designing, developing and maintaining complex data pipelines on Azure platforms.
• Data Migration: Experience in migrating data from on-premises and cloud-based systems to Azure, ensuring seamless data integration.
• Data Modeling: Proficient in dimensional data modeling and designing data warehouses for efficient data storage and retrieval.
• Azure Services Proficiency: Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake and Azure SQL Database.
• Programming Skills: Robust proficiency in Python and SQL; familiarity with Scala is advantageous.
• Big Data Frameworks: Experience with big data frameworks, particularly Apache Spark, for large-scale data processing.
• Version Control and CI/CD: Familiarity with Azure DevOps, Git and implementing CI/CD pipelines for automated deployments.
• Security Practices:
Knowledge of Azure security practices, including Azure Active Directory (AAD), Key Vault and Role-Based Access Control (RBAC).
Role & Responsibilities
• Data Pipeline Management: Design, develop and maintain complex data pipelines on Azure to support business requirements.
• Data Migration: Migrate data from on-premises and cloud-based systems to Azure platforms, ensuring data integrity and security.• Data Modeling and Warehousing: Implement and optimize dimensional data models and data warehouses for scalable and efficient data processing.
• Azure Services Utilization: Work extensively with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake and Azure SQL Database to manage and process large datasets.
• Programming: Write efficient and scalable code using Python and SQL to support data engineering workflows.
• ETL/ELT Processes: Develop and maintain ETL/ELT processes, leveragi
📌 Azure Data Engineer (Gurugram)
🏢 byval technologies india
📍 Gurugram