Location: Hyderabad, India

Technologies: Python, PySpark, SQL, Spark, Hadoop Ecosystem

Role Overview A Senior Python and PySpark Developer leads the design, development, and delivery of scalable Python and PySpark-based solutions. The role ensures application quality, performance, maintainability, and efficient processing of large-scale datasets while guiding the engineering team and collaborating with stakeholders.

Key Responsibilities

- Lead design and development of Python and PySpark applications

- Develop scalable data processing pipelines using PySpark

- Design and optimize ETL/ELT solutions for large-volume datasets

- Define coding standards, best practices, and development guidelines

- Review and optimize application and Spark job performance

- Handle complex business logic, integrations, and data transformations

- Work with structured and unstructured data across multiple sources

- Implement data quality, validation, and reconciliation processes

- Collaborate with Data Architects, Data Engineers, and Business stakeholders

- Mentor junior and mid-level developers on Python, PySpark, and data engineering best practices

- Support release planning, production stability, troubleshooting, and performance tuning

- Ensure adherence to security, governance, and compliance standards

Required Skills

Python

- Expert-level Python development experience

- Robust understanding of Object-Oriented Programming (OOP), design patterns, and coding best practices

- Experience in building scalable and maintainable applications





- Strong debugging, performance tuning, and code review skills

PySpark & Big Data

- Strong hands-on experience with PySpark and Apache Spark

- Experience developing distributed data processing applications

- Good understanding of Spark architecture, executors, partitions, and cluster computing concepts

- Experience with Spark SQL, DataFrames, Window Functions, UDFs, and optimization techniques

- Knowledge of Spark performance tuning including partitioning, caching, broadcasting, and resource management

- Experience handling large-scale datasets in distributed environments

- Familiarity with data formats such as Parquet, Avro, ORC, and JSON

- Experience integrating Spark with cloud storage and relational databases through JDBC

SQL & Data Engineering

- Strong SQL development and query optimization skills

- Experience designing ETL/ELT pipelines and data transformation frameworks

- Understanding of data warehousing concepts and dimensional modeling

- Experience working with databases such as SQL Server, Oracle, PostgreSQL, DB2, or Snowflake

Project Location 1 : TELANGANA | HYDERABAD

Relevant Experience : 5+years

Mandatory skills: Python Development

Desired skills : Python Development

Domain (Industry): Financial or Banking will be preferred

Total Experience (Ex. 5-7 Years): 5+ years

Mode of Interview: Face to Face

WFO / WFH / Hybrid : Hybrid

Please enter shift timings : General Shift with onshore overlap for 2 hours

📌 Python/PySpark developer__Hybrid__Hybrid (Hyderabad)
🏢 Trigent Software
📍 Hyderabad