Job Title: Senior Data Engineer (Azure Databricks)
Role Type: Fixed Term Direct Contract with Talpro
Contract Duration: 6 months (Fixed Term Contract)
Years of Experience: 6+ Yrs.
Max CTC Offered: INR 1.50 L Per Months
Notice Period: Immediate Joiners Only
Work Mode: Hybrid (3 Days from Office Weekly)
Location: Manyata Tech Park, Bengaluru - Looking for Bengaluru Based Candidates only
Domain: Any IT Domain
About the Role
Talpro is seeking a Senior Data Engineer (Azure Databricks) for an internal position to be deployed at a client location. This is a 6-month contract-to-hire role – if you excel during the contract, there is potential to transition into a permanent position. You will be on Talpro’s payroll and work with the client’s team in Bangalore. The work model is hybrid (mix of on-site and remote as needed) and aligned to UK business hours (approximately 2 PM to 7 PM IST).
Key Responsibilities
- Data Pipeline Development: Design and implement highly performant,
metadata-driven data ingestion and transformation pipelines from multiple sources using Azure Databricks and Apache Spark. This includes building both streaming and batch data processes to handle large-scale data in real time and in bulk.
- Framework & Optimization: Develop scalable and reusable frameworks for data ingestion and transformation of large datasets. Perform Spark performance tuning and optimization to ensure data pipelines are effective and cost-effective. Provide technical guidance on complex data problems (including handling geospatial data) using Spark DataFrames and other big data tools.
- Data Quality & Integration: Design and implement data quality checks and processes to ensure data integrity is maintained through the pipeline. Integrate end-to-end data pipelines from source systems to target data repositories (data lakes/data warehouses), ensuring consistency, quality, and reliability of data at all times.
- Collaboration & Tooling: Work closely with cross-functional teams
📌 Senior Data Engineer (Bengaluru)
🏢 Talpro INdia
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.