Senior Data Engineer (Bengaluru)

Senior Data Engineer (Bengaluru)

20 Nov
|
Vivanti Consulting
|
Bengaluru

20 Nov

Vivanti Consulting

Bengaluru

About the job Your Career, Accelerated Vivanti was founded as a platform for talented technologists who want to make a real impact for their clients. Some of the world’s biggest businesses turn to us to help bring their data strategy, AI, cloud engineering and digital solutions to life. We’re the home base for talented technologists who want more and are looking to take their career to the next level by having more learning, more variety, more support and more chances to do meaningful work. If that sounds like the kind of place you’d thrive in, keep reading. What You’ll Get We know you're bringing the skills, the passion and the drive. What we bring is the platform to help you go further. At Vivanti, you're not just taking a job, you're investing in your growth. Here’s a taste:
• A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.
• Access global businesses: Work with some of the world's biggest brands
• IP, frameworks and accelerators: We share what we know. Our playbooks and toolkits fast-track your success on projects.
• Access to a broad ecosystem of technologies
• Senior consultants who have your back: You’ll always have a guide on your journey, not just be thrown into the deep end.
• Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.
• Progress that’s transparent: Annual Progress Reviews based on 360° feedback, not vague vibes. Clear goals, solid feedback and real growth.
• Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.
• Real connection: From Friday socials to annual team building days
- we work hard and play harder. What We’re Looking For We are on the hunt for a Technical Builder
- someone who doesn’t just move data around, but understands how to architect it for impact on Microsoft Fabric. You are a problem-solver who enjoys the “heavy lifting” of untangling complex raw data from many sources and turning it into a reliable, governed, analytics-ready asset in OneLake. Microsoft Fabric is the #1 essential skill for this role. Snowflake experience is an added advantage. We’re less about ticking boxes and more about whether you’d thrive in this environment:
• The “Translator” Mindset: Can you sit in a workshop with a business leader, understand their pain points, then design the lakehouse, pipeline or SQL solution that solves them?
• Modern Engineering Passion: Do you get excited about PySpark notebooks, Delta Lake, Git, CI/CD and the shift toward “Analytics Engineering”?
• Architectural Curiosity: Do you enjoy debating medallion layers, Lakehouse vs. Warehouse or Kimball vs. Data Vault to find the right fit for the business’s scale?
• Ownership & Accountability: Do you own your pipelines from design to production, and hold yourself accountable for data quality, SLAs and trust in the numbers?
• Adaptability: Are you comfortable adapting to changing business needs without losing quality?
• The Consultant’s Edge: Do you enjoy working across different domains and helping businesses navigate their data journey?




• The Standard-Setter: Do you enjoy turning what works into repeatable standards, templates and accelerators that make the whole team faster? The Essentials
•

Experience:
7+ years in Data Engineering on the Microsoft data platform (e.g., Azure Data Factory, Synapse, SQL Server, SSIS, Azure Databricks, Power BI), including 1–2 years of hands-on Microsoft Fabric with at least one production implementation.
• Advanced SQL & Python: Expert SQL (T-SQL and Spark SQL) and strong Python/PySpark for large-scale transformation.
• Hands-on Fabric Setup & Operation: Workspaces, OneLake and shortcuts, Lakehouse and Warehouse, Data Factory pipelines, Dataflows Gen2, Notebooks, mirroring, connections, gateways and permissions. You can configure an approved environment and build an end-to-end proof of concept without a separate platform engineer.
• A Proven Builder: Data modelling (Kimball, Data Vault or Inmon) on a medallion architecture, and modern ELT pipelines with incremental loads, CDC, metadata-driven frameworks and monitoring. Strong Delta Lake

skills:
MERGE, SCD Type 2, partitioning, V-Order, OPTIMIZE/VACUUM and Spark tuning.
• Standards & Frameworks: Proven experience defining data engineering standards, reference architectures and reusable accelerators that other engineers have adopted.
• Governance, Security & DevOps: Workspace roles, OneLake security, row
- and column-level security, sensitivity labels, Purview lineage, Git integration, deployment pipelines and CI/CD across Dev / Test / Prod.
• Communication & Teamwork: Run requirement workshops, explain trade-offs in plain language and document clearly, within agile, multidisciplinary teams.
•

Working Hours
&

Location:
12:00 PM – 9:00 PM (IST) shift to overlap with global stakeholders.
• Tool-Agnostic Learner: Fabric is our core platform, but you’re eager to learn others, such as Databricks and Google BigQuery, as business needs evolve. Nice to Have
• DP-700 certification: Microsoft Certified: Fabric Data Engineer Associate.
• Snowflake: Foundational Snowflake engineering, such as SQL, data engineering, semantic views and Cortex (Snowflake’s AI features).
• Real-Time Intelligence: Eventstream, Eventhouse and KQL for streaming and near-real-time analytics.
• Fabric migrations: Moving workloads from Azure Synapse, Azure Data Factory, SSIS or on-premises SQL Server to Fabric.
• dbt: Building tested, documented transformation models.
• Capacity, cost & observability: The Fabric Capacity Metrics app, data quality frameworks (e.g., Great Expectations) and pipeline alerting.
• AI-ready data: Fabric Data Science, Copilot in Fabric, or preparing data for ML models and AI agents.
• Sales collateral: Solution one-pagers,



case studies and pitch decks that show the value of data solutions to clients and prospects. What You’ll Do
• Own Microsoft Fabric engineering standards & best practices (an essential part of the role): Develop, document and continuously improve enterprise data engineering standards and architectural patterns for Fabric, with complementary Snowflake expertise, including:
• Frameworks & guidelines: Reference architectures, ingestion and transformation patterns, medallion and semantic modelling standards, performance optimisation, and security and governance best practices.
• Accelerators & templates: Reusable accelerators, deployment templates, automation scripts and reference implementations that speed up client delivery.
• Demos & proofs of value: Demonstrations, POCs and proofs of value that promote engineering excellence, consistency and scalability across Vivanti’s data platform solutions.
• Be the Fabric release champion: Be the point person for new Fabric, OneLake and AI-enabled data engineering capabilities: track GA vs. preview, assess capacity and tenant impact, and advise on what to adopt.
• Discover and translate: Run stakeholder workshops and turn requirements into scalable data solutions.
• Architect and build: Design medallion Lakehouse and Warehouse solutions in OneLake, ingesting from databases, APIs, files and SaaS apps with the right pattern (pipelines, shortcuts, mirroring or streaming).
• Transform and model: Turn raw data into clean, well-tested datasets with PySpark and SQL (dbt where applicable), and design dimensional models for analytics and reporting.
• Serve analytics-ready data: Deliver trusted, well-documented Gold-layer and semantic-ready datasets for Power BI (including Direct Lake) and self-service users.
• Ensure quality and performance: Implement data tests, monitoring and alerting, and optimise Delta tables, Spark jobs and capacity usage.
• Own production: Take accountability for pipeline SLAs, troubleshoot failures quickly, find root causes and prevent repeat issues.
• Collaborate across disciplines: Work with BI, Cloud and AI/ML engineers to deliver end-to-end data products. Perks & Perks Your work matters—and so do you. That’s why we back your skills with a structure that supports your development, celebrates your wins, and helps you keep growing
- professionally and personally. Here’s what’s waiting for you:
• Vivanti Articulate – our public speaking & communication program
• Mentoring Program – with a Senior Support Lead
• 360° Progress Reviews – honest feedback, not fluff
• Guilds & Weekly Training – learn from your peers
• Paid Certifications – across all major technologies
• Hackathons & Innovation Days – challenge yourself, build cool stuff
• Kudos & Recognition Programs – great work doesn’t go unnoticed
• Socials & Team Days – Data-Coolada Fridays, Team Building days, and more Final Word If you're looking for the place where your growth will go into overdrive, where you'll work with great humans, get access to cutting-edge tools and genuinely enjoy the ride? Welcome to Vivanti.

📌 Senior Data Engineer (Bengaluru)
🏢 Vivanti Consulting
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (bengaluru) / bengaluru