09 Sep
|
VARITE
|
Bengaluru
Company Name: VARITE India Private Limited
About The Client
CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments.
About The Job:
- We are seeking a highly skilled Senior Data Engineer with extensive experience in Data Engineering, Data Warehousing, Microsoft Fabric, Azure Data Services, and modern cloud-based data platforms. The ideal candidate will be responsible for designing, developing, and optimizing enterprise-scale data solutions, leading data engineering initiatives, and collaborating with business and technical stakeholders to enable scalable, secure, and high-performance data ecosystems.
- This role requires deep expertise in Microsoft Fabric, Azure Data Factory (ADF), SQL, Data Modeling, and Data Architecture, along with the ability to mentor junior engineers and drive best practices across the organization.
Essential Job Functions:
- Design, develop, and maintain scalable and high-performance data pipelines using Microsoft Fabric, Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Services.
- Lead the architecture, implementation, and optimization of enterprise data platforms and data warehouse solutions.
- Develop and optimize ETL/ELT frameworks to support large-scale data integration and transformation requirements.
- Design and implement dimensional data models, star schemas, snowflake schemas, and data marts to support business intelligence and analytics.
- Build and manage data lakehouse architectures leveraging Microsoft Fabric.
- Establish data governance, data quality, metadata management, and security best practices.
- Collaborate with business stakeholders, architects, analysts, and development teams to define and implement data strategies.
- Optimize SQL queries, stored procedures, indexing strategies, and database performance.
- Monitor, troubleshoot, and resolve complex data pipeline and platform issues.
- Implement CI/CD practices and automation for data engineering workflows.
- Mentor and guide junior and mid-level data engineers by providing technical leadership and best-practice recommendations.
- Evaluate emerging Azure and Microsoft Fabric capabilities and recommend improvements to existing data architectures.
- Support advanced analytics, AI/ML,
and reporting initiatives through robust data engineering solutions.
Other Responsibilities
- Provide technical leadership and guidance across data engineering projects.
- Participate in architecture reviews, design discussions, and strategic technology planning.
- Communicate project status, risks, dependencies, and mitigation plans to leadership and stakeholders.
- Ensure adherence to organizational standards, compliance requirements, and security policies.
- Foster strong collaboration with cross-functional teams and business units.
- Support production deployments, troubleshooting, and performance optimization initiatives.
Qualifications
- 7-10 Years
Education and Experience
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Master's degree preferred.
- Equivalent combination of education and relevant work experience may be considered.
Required Qualifications
- 4+ years of experience in Data Engineering, with at least 3+ years of experience working on Azure-based data platforms.
- Strong expertise in SQL, query optimization, performance tuning, indexing, partitioning, and stored procedures.
- Extensive experience with Microsoft Fabric, including Lakehouse, Data Factory, Data Warehouse, Real-Time Analytics, and Data Engineering workloads.
- Advanced experience with Azure Data Factory (ADF) and enterprise ETL/ELT development.
- Strong knowledge of Data Warehousing concepts, dimensional modeling, star/snowflake schemas, and data architecture.
- Hands-on experience with Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage (ADLS), Azure Storage Accounts, and related Azure services.
- Strong experience with Python, PySpark, Spark SQL, or similar technologies for data transformation and processing.
- Experience implementing data governance, security, lineage, and metadata management frameworks.
- Knowledge of CI/CD pipelines, source control,
and DevOps practices for data engineering.
- Solid analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Experience with real-time and streaming data technologies such as Azure Event Hubs, Stream Analytics, Kafka, or Fabric Real-Time Analytics.
- Experience supporting AI/ML and advanced analytics initiatives.
- Knowledge of Power BI architecture, semantic models, and enterprise reporting solutions.
- Experience working in Agile/Scrum environments.
- Microsoft Certifications such as
- DP-203: Azure Data Engineer Associate
- DP-600: Fabric Analytics Engineer Associate
- DP-700: Microsoft Fabric Data Engineer Associate
- Other relevant Azure or Microsoft certifications.
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
0-2 years
INR 5,000
2-6 years
INR 7,500
6+ years
INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
📌 Senior Data Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru