19 Nov
|
Careerfit.ai
|
Bengaluru
19 Nov
Careerfit.ai
Bengaluru
Senior Data Engineer II
Location: Bengaluru / Gurugram / Mumbai
About the Role
This is a client-facing Senior Data Engineer role where you'll design and deploy scalable data pipelines, lead cloud migration initiatives, and act as a trusted technical partner to clients on their data platform modernization journeys. You'll work hands-on with Databricks, Spark, and AWS to build governed, high-performance lakehouse architectures, while also guiding and mentoring engineers on your project team.
What You Will Do
1. Design and deploy scalable data pipelines handling JSON, Parquet, CSV, and ORC formats for both batch and streaming ingestion
2. Build high-performance Spark pipelines to support cloud migration initiatives
3. Architect and maintain Medallion Architecture frameworks (Bronze, Silver, Gold tables)
4. Optimize on-premises Spark codebases for cloud environments
5. Establish data modeling practices aligned with governance standards
6. Implement data cataloging using Unity Catalog for data integrity and quality
7.
Build and manage Delta Live Tables (DLT) pipelines for secure data operations
8. Partner directly with clients to shape cloud migration strategy and enforce best practices in design and governance
9. Guide and mentor engineers on your project as a technical lead
What We're Looking For
1. Minimum 5 years of hands-on data engineering experience, including complex pipeline development and cloud migration projects
2. Bachelor's degree (BE/B.Tech) in Computer Science, Data Engineering, or a closely related field
3. Advanced proficiency in Spark, SQL, and Python
4. Hands-on experience with Databricks (Unity Catalog, Delta Live Tables, Medallion Architecture)
5. Solid working knowledge of AWS services; exposure to GCP or Azure is a plus
6. Robust communication skills for direct client engagement
7. Cloud certification (AWS/GCP/Azure Data Engineering) preferred but not mandatory
📌 Senior Data Engineer II (Bengaluru)
🏢 Careerfit.ai
📍 Bengaluru