Data Software Engineer – Spark, Python, Databricks (L2 / L4)
Experience:
L2: 4–5 Years
L4: 8–12 Years
Mode: FTE (Full-Time Employment)
Job Location: Bangalore
Work Mode: Hybrid
Notice Period:
L2: Immediate to 15 days
L4: Immediate to 15 days
Drive Type: F2F
Drive Location: Bangalore
CTC Band:
L2: Up to 21 LPA
L4: Up to 42 LPA
Role Overview
We are hiring Data Software Engineers with strong expertise in Apache Spark, Python, and AWS/Azure Databricks. The ideal candidates will have deep Big Data engineering experience, robust distributed systems knowledge, and the ability to work on complex end-to-end data platforms at scale.
Key Responsibilities
Big Data Engineering
Design and build distributed data processing systems using Spark and Hadoop.
Develop and optimize Spark applications, ensuring performance and scalability.
Create and manage ETL/ELT pipelines for large-scale data ingestion and transformation.
Streaming & Event Processing
Build and manage real-time streaming systems using Spark Streaming or Storm.
Work with Kafka / RabbitMQ for event-driven ingestion and messaging patterns.
Cloud & Databricks Engineering
Develop & optimize workloads on AWS Databricks or Azure Databricks.
Perform cluster management, job scheduling, performance tuning, and automation.
Data Integration & Storage
Integrate data from diverse sources: RDBMS (Oracle, SQL Server), ERP, file systems.
Work with query engines like Hive and Impala.
Experience with NoSQL stores: HBase, Cassandra, MongoDB.
Programming & Scripting
Solid hands-on coding in Python for data transformations and automations.
Robust SQL skills for data validation, tuning, and complex queries
Team Leadership (L4)
Provide technical leadership and mentoring to junior engineers.
Drive solution design for Big Data platforms end-to-end
Ways of Working
Work in Agile teams, participate in sprint ceremonies and planning.
Collaborate with engineering, data science, and produc
📌 Data Software Engineer – Spark, Python, Databricks Bengaluru
🏢 Talpro INdia
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.