Position: PySpark Developer / Senior Data Engineer

Experience: 10+ Years (Relevant Experience Mandatory)

Location: Hyderabad | Bangalore | Pune | Chennai

Employment Type: Contract to Hire (C2H)

Work Mode: Hybrid

Working Days: 5 Days/Week

Shift Timings: 11:00 AM – 8:00 PM IST

Interview Process: 3 Rounds

Notice Period: 0–15 Days

Job Summary

We are seeking an experienced PySpark Developer / Senior Data Engineer with robust expertise in PySpark, Python, SQL, and Google BigQuery. The ideal candidate will design, develop, and optimize scalable ETL/ELT pipelines while ensuring high-performance data processing and quality in a cloud-based environment.

Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using PySpark.
Build and optimize Spark-based data processing workflows for large datasets.
Develop robust data transformation logic using Python and SQL.
Work with Google BigQuery for data warehousing and analytics.
Optimize data pipelines for performance, scalability, and reliability.




Implement data quality, governance, and observability best practices.
Collaborate with cross-functional teams in an Agile environment.
Troubleshoot, debug, and optimize existing data engineering solutions.
Participate in code reviews and contribute to engineering best practices.

Required Skills
Robust hands-on experience with PySpark, Python, and SQL.
Experience designing and optimizing Spark-based ETL/ELT pipelines.
Solid understanding of Google BigQuery.
Knowledge of data quality, governance, observability, and performance tuning.
Strong analytical, debugging, and problem-solving skills.
Experience working in Agile/Scrum teams.

Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
6+ years of Data Engineering experience with strong hands-on expertise in PySpark.

📌 Senior Pyspark Developer / Senior Data Engineer Hyderabad (India)
🏢 One step Omni Tech services
📍 India