19 Sep
|
HIRESTAR JOB BANK
|
Bengaluru
19 Sep
HIRESTAR JOB BANK
Bengaluru
Python & PySpark Developer – Hiring Experience: 5–7 Years
Openings: 2
Location: Bangalore
CTC: 15–18 LPA We are looking for an experienced Python & PySpark Developer to design, develop, optimize, and maintain scalable data processing applications and ETL pipelines. Key Responsibilities:
• Develop and maintain scalable data pipelines and ETL processes using Python and PySpark.
• Optimize PySpark applications and workflows for performance and efficiency.
• Work with big data technologies such as Hadoop, Hive, Kafka, AWS, and Databricks Lakehouse.
• Ensure data quality, validation, reconciliation, and integrity.
• Monitor and troubleshoot production data processing jobs.
• Collaborate with Data Engineers, Data Scientists, and cross-functional teams. Required Skills:
• Strong proficiency in Python and PySpark.
• Expertise in Apache Spark, Spark SQL, and DataFrames.
• Solid SQL and database knowledge.
• Positive understanding of ETL, Data Warehousing, Data Pipelines, Quality Gates, and Reconciliation.
• Experience handling large-scale datasets.
• Solid analytical, debugging, and problem-solving skills.
• Excellent communication and collaboration skills.
📌 Python & Pyspark Developer Bengaluru
🏢 HIRESTAR JOB BANK
📍 Bengaluru