Job Description

Job Summary

n

We are seeking an experienced Data Engineer (PySpark) to join our Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines, data marts, and analytical solutions. The role requires strong expertise in Python, PySpark, SQL, Data Warehousing, and Big Data technologies , along with hands-on experience across the end-to-end Software Development Life Cycle (SDLC).

n

n

Key Responsibilities

n

n
- Design, develop, and maintain scalable ETL pipelines and data processing frameworks.
n
- Build and support Data Mart solutions to meet business and analytical requirements.
n
- Develop high-quality, maintainable, and efficient code using Python and PySpark.
n
- Participate in the complete Software Development Life Cycle (SDLC), including:
n
- Requirement Analysis
n
- Development
n
- Unit Testing
n
- UAT Support
n
- Defect Fixing
n
- Production Deployment
n
- Post-Production Support
n
- Perform complex data analysis and troubleshoot data-related issues.
n
- Debug and optimize PySpark applications for performance and reliability.
n
- Write and optimize complex Oracle SQL queries.
n
- Work with structured, semi-structured, and unstructured datasets.
n
- Implement data quality, validation, and monitoring processes.
n
- Collaborate with cross-functional teams to resolve dependencies and ensure timely project delivery.
n
- Follow software engineering best practices, coding standards, testing methodologies, and CI/CD processes.
n

n

n





Required Skills & Experience

n

Data Engineering & Big Data

n

n
- PySpark
n
- Apache Spark
n
- Hadoop Ecosystem
n
- MapReduce
n
- Hive
n
- ETL Development
n
- Data Pipeline Development
n
- Data Mart Development
n
- Data Warehousing
n

n

Programming

n

n
- Python
n
- Pandas
n
- Jupyter Notebook
n

n

Database Technologies

n

n
- Oracle SQL
n
- SQL
n
- NoSQL Databases
n
- Query Optimization
n
- Data Analysis
n

n

Workflow & Automation

n

n
- Apache Airflow
n
- Oozie
n
- Jenkins
n
- Git
n
- CI/CD Pipelines
n

n

Data Engineering Techniques

n

n
- Data Cleansing
n
- Data Linking
n
- Feature Engineering
n
- Data Imputation Techniques
n
- Data Validation and Quality Checks
n

n

n

Preferred Experience

n

n
- Banking or Financial Services domain experience.
n
- Experience supporting enterprise-scale data platforms.
n
- Exposure to production support and deployment activities.
n
- Experience working in Agile environments.
n

n

n

Desired Competencies

n

n
- Strong analytical and problem-solving skills.
n
- Excellent debugging and troubleshooting capabilities.
n
- Ability to lead technical initiatives with ownership and accountability.
n
- Robust collaboration and stakeholder management skills.
n
- Excellent verbal and written communication skills.
n
- Ability to communicate effectively with both technical and non-technical stakeholders.
n
- Ability to prioritize tasks and perform effectively in a fast-paced environment.
n

n

📌 Pyspark Data Engineer (Bengaluru)
🏢 Synechron
📍 Bengaluru