09 Sep
|
VARITE
|
Bengaluru
Company Name: VARITE India Private Limited
About The Client:
Client provides industry-leading audit, consulting, tax and advisory services to many of the world's most admired brands, including nearly 90% of the Fortune 500® and more than 9000 U.S.-based private companies.
About The Job:
- Work Timings: 01:30 - 10:30 PM
- Design, build, and maintain scalable data pipelines and data platforms on Azure.
- Enable reliable data flow for analytics, reporting, and business use cases.
- Ensure high-quality, secure, and productive data solutions.
Essential Job Functions:
- Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse.
- Build and manage data ingestion frameworks from multiple sources (APIs, databases, files, streaming).
- Implement data transformations using SQL, Python, and Spark.
- Design data lake architecture (raw, curated, and consumption layers).
- Optimize pipelines for performance, cost, and scalability.
- Develop reusable data engineering components and frameworks.
- Implement error handling, logging, and monitoring mechanisms.
- Perform data validation and resolve data quality issues.
- Work with structured and unstructured large-scale datasets.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Support and enhance existing data platforms and pipelines.
- Follow best practices for security, governance, and compliance.
- Participate in design discussions and architecture reviews.
Qualifications:
Technical Skills:
- Azure Data Factory (ADF)
- Azure Databricks (Spark)
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
Experience Requirements:
- 7–8 years of overall IT experience.
- Minimum 4+ years in Azure Data Engineering.
- Hands-on experience in production-grade pipeline development.
- Experience working in agile development environments.
- Knowledge of Power BI or reporting tools.
Good to Have:
- Experience with real-time/streaming pipelines.
- Exposure to Azure AI/ML se
📌 Senior Azure Data engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru