Job DescriptionJob Summary
nWe are seeking an experienced Data Engineer (PySpark) to join our Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines, data marts, and analytical solutions. The role requires solid expertise in Python, PySpark, SQL, Data Warehousing, and Big Data technologies, along with hands-on experience across the end-to-end Software Development Life Cycle (SDLC).
nKey Responsibilities
n
n
Design, develop, and maintain scalable ETL pipelines and data processing frameworks.n
Build and support Data Mart solutions to meet business and analytical requirements.n
Develop high-quality, maintainable, and effective code using Python and PySpark.n
Participate in the complete Software Development Life Cycle (SDLC), including:n
Requirement Analysisn
Developmentn
Unit Testingn
UAT Supportn
Defect Fixingn
Production Deploymentn
Post-Production Supportn
Perform complex data analysis and troubleshoot data-related issues.n




Debug and optimize PySpark applications for performance and reliability.n
Write and optimize complex Oracle SQL queries.n
Work with structured, semi-structured, and unstructured datasets.n
Implement data quality, validation, and monitoring processes.n
Collaborate with cross-functional teams to resolve dependencies and ensure timely project delivery.n
Follow software engineering best practices, coding standards, testing methodologies, and CI/CD processes.n

nRequired Skills & Experience
nData Engineering & Big Data
n
n
PySparkn
Apache Sparkn
Hadoop Ecosystemn
MapReducen
Hiven
ETL Developmentn
Data Pipeline Developmentn
Data Mart Developmentn
Data Warehousingn

nProgramming
n
n
Pythonn
Pandasn
Jupyter Notebookn

nDatabase Technologies
n
n
Oracle SQLn
SQLn
NoSQL Databasesn
Query Optimizationn
Data Analysisn

nWorkflow & Automation
n
n
Apach

📌 Pyspark Data Engineer Karnataka
🏢 Synechron
📍 Karnataka