Role & responsibilities

Role: Senior Data Engineer Spark/PySpark/Scala/Hive | Experience: 7 years | Location: Bangalore, Hybrid

- Design, develop, deploy, and support enterprise-scale Data Lake and distributed processing solutions using Spark, PySpark, Scala, Python, Hive, Spark SQL, and Airflow.
- Build modular, testable, reusable ETL pipelines across HDFS, Hive, Parquet, and Cloudera CDP on-premises environments.
- Apply partitioning, bucketing, schema evolution, data quality, reconciliation, error handling, monitoring, recovery, and security practices.
- Optimize workloads through expertise in joins, shuffles, serialization, caching, partition sizing, file formats, query plans, and resource utilization.
- Implement data modeling, CI/CD, Git, GitLab, Jenkins, Maven/SBT, release, and operational practices.




- Troubleshoot logs, failures, performance bottlenecks, and production incidents through effective root-cause analysis.
- Demonstrate robust conceptual depth, coding discipline, analytical thinking, and attention to detail.
- Communicate clearly, challenge assumptions, learn rapidly, and convert ambiguity into pragmatic outcomes.
- Own customer-facing delivery with a Forward Deployed Engineer mindset: adaptable, hands-on, action-oriented, and accountable.
- Use Claude, Cursor, and Copilot responsibly for coding, testing, automation, and documentation.

Preferred candidate profile

📌 PySpark, Scala, Python Job Opportunity with Hexaware !!! (Pune)
🏢 Hexaware Technologies
📍 Pune