Data Software Engineer – Spark, Python, Databricks (L2 / L4)
Experience:
- L2: 4–5 Years
- L4: 8–12 Years
Mode: FTE (Full-Time Employment)
Job Location: Bangalore
Work Mode: Hybrid
Notice Period:
- L2: Immediate to 15 days
- L4: Immediate to 15 days
Drive Type: F2F
Drive Location: Bangalore
CTC Band:
- L2: Up to 21 LPA
- L4: Up to 42 LPA
Role Overview
We are hiring Data Software Engineers with strong expertise in Apache Spark, Python, and AWS/Azure Databricks. The ideal candidates will have deep Big Data engineering experience, robust distributed systems knowledge, and the ability to work on complex end-to-end data platforms at scale.
Key Responsibilities
Big Data Engineering
- Design and build distributed data processing systems using Spark and Hadoop.
- Develop and optimize Spark applications, ensuring performance and scalability.
- Create and manage ETL/ELT pipelines for large-scale data ingestion and transformation.
Streaming & Event Processing
- Build and manage real-time streaming systems using Spark Streaming or Storm.
- Work with Kafka / RabbitMQ for event-driven ingestion and messaging patterns.
Cloud & Databricks Engineering
- Develop & optimize workloads on AWS Databricks or Azure Databricks.
- Perform cluster management, job scheduling, performance tuning, and automation.
Data Integration & Storage
- Integrate data from diverse sources: RDBMS (Oracle, SQL Server), ERP, file systems.
- Work with query engines like Hive and Impala.
- Experience with NoSQL stores: HBase, Cassandra, MongoDB.
Programming & Scripting
- Strong hands-on coding in Python for data transformations and automations.
- Strong SQL skills for data validation, tuning, and complex queries
Team Leadership (L4)
- Provide technical leadership and mentoring to junior engineers.
- Drive solution design for Big Data platforms end-to-end
Ways of Working
- Work in Agile teams, participate in sprint ceremonies and planning.
- Collaborate with engineering, data science, and produc
📌 Data Software Engineer – Spark, Python, Databricks (Bengaluru)
🏢 Talpro INdia
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.