10 Sep
|
VARITE
|
Bengaluru
Company Name: VARITE India Private Limited
About The Client:
Client provides industry-leading audit, consulting, tax and advisory services to many of the world's most admired brands, including nearly 90% of the Fortune 500® and more than 9000 U.S.-based private companies.
About The Job:
Work Timings: 01:30 - 10:30 PM
Design, build, and maintain scalable data pipelines and data platforms on Azure.
Enable reliable data flow for analytics, reporting, and business use cases.
Ensure high-quality, secure, and productive data solutions.
Essential Job Functions:
Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse.
Build and manage data ingestion frameworks from multiple sources (APIs, databases, files, streaming).
Implement data transformations using SQL, Python, and Spark.
Design data lake architecture (raw, curated, and consumption layers).
Optimize pipelines for performance, cost, and scalability.
Develop reusable data engineering components and frameworks.
Implement error handling, logging, and monitoring mechanisms.
Perform data validation and resolve data quality issues.
Work with structured and unstructured large-scale datasets.
Collaborate with stakeholders to understand data requirements and deliver solutions.
Support and enhance existing data platforms and pipelines.
Follow best practices for security, governance, and compliance.
Participate in design discussions and architecture reviews.
Qualifications:
Technical Skills:
Azure Data Factory (ADF)
Azure Databricks (Spark)
Azure Synapse Analytics
Azure Data Lake Storage (ADLS)
Experience Requirements:
7–8 years of overall IT experience.
Minimum 4+ years in Azure Data Engineering.
Hands-on experience in production-grade pipeline development.
Experience working in agile development environments.
Knowledge of Power BI or reporting tools.
Valuable to Have:
Experience with real-time/streaming pipelines.
Exposure to Azure AI/ML se
📌 Senior Azure Data Engineer Bengaluru
🏢 VARITE
📍 Bengaluru