20 Nov
|
Careerfit.ai
|
Bengaluru
20 Nov
Careerfit.ai
Bengaluru
Senior Data Engineer II
Location: Bengaluru / Gurugram / Mumbai
About the Role
This is a client-facing Senior Data Engineer role where you'll design and deploy scalable data pipelines, lead cloud migration initiatives, and act as a trusted technical partner to clients on their data platform modernization journeys. You'll work hands-on with Databricks, Spark, and AWS to build governed, high-performance lakehouse architectures, while also guiding and mentoring engineers on your project team.
What You Will Do
Design and deploy scalable data pipelines handling JSON, Parquet, CSV, and ORC formats for both batch and streaming ingestion
Build high-performance Spark pipelines to support cloud migration initiatives
Architect and maintain Medallion Architecture frameworks (Bronze, Silver, Gold tables)
Optimize on-premises Spark codebases for cloud settings
Establish data modeling practices aligned with governance standards
Implement data cataloging using Unity Catalog for data integrity and quality
Build and manage Delta Live Tables (DLT) pipelines for secure data operations
Partner directly with clients to shape cloud migration strategy and enforce best practices in design and governance
Guide and mentor engineers on your project as a technical lead
What We're Looking For
Minimum 5 years of hands-on data engineering experience, including complex pipeline development and cloud migration projects
Bachelor's degree (BE/B.Tech) in Computer Science, Data Engineering, or a closely related field
Advanced proficiency in Spark, SQL, and Python
Hands-on experience with Databricks (Unity Catalog, Delta Live Tables, Medallion Architecture)
Solid working knowledge of AWS services; exposure to GCP or Azure is a plus
Robust communication skills for direct client engagement
Cloud certification (AWS/GCP/Azure Data Engineering) preferred but not mandatory
📌 Senior Data Engineer Ii Bengaluru
🏢 Careerfit.ai
📍 Bengaluru