Job Title : Azure Data Engineer
Location : Pune, Hyderabad, Bangalore
Experience : 7 to 12 years.
Skills : Databricks, Spark/ Pyspark/ Python, ETL, ADF/ Airflow
Notice Period : Immediate to 45 Days
:
- Expert level skills writing and optimizing complex SQL.
- Experience with complex data modelling, ETL design, and using large databases in a business workplace.
- Experience with building data pipelines and applications to stream and process datasets at low latencies.
- Fluent with Big Data technologies like Spark, Kafka and Hive.
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
- Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
- Experience in developing NO SQL solutions using Azure Cosmos DB is essential.
- Thorough understanding of Azure and AWS Cloud Infrastructure offerings.
- Working knowledge of Python is desirable.
- Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
- Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
- Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
- Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
- Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
- Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging.
📌 Wipro - Azure Data Engineer - Spark/Python (India)
🏢 Wipro
📍 India