Please find the below JD

Client: Finance based client

Location: Gurgaon

Hybrid 3 days office

We are looking for a Data Engineer with the below experience

- Python
- Pyspark
- Orchestration - Not mandatory
- AWS or azure

Key Responsibilities Build and maintain scalable data pipelines across stages such as data download, ingestion, and analysis within a bespoke data platform.

Develop high-performance data processing logic using Python and PySpark.

Perform large-scale transaction data analysis using custom algorithms and in-house logic to detect financial crime patterns.

Work with high-volume datasets (8090 million records processed regularly) and optimize pipeline performance.

Design efficient data models and transformations for large-scale processing.

Write optimized SQL queries on PostgreSQL (RDS), leveraging:

- Window functions
- Partitioning
- Query performance optimization

Work with Delta tables and Parquet-based storage formats for productive data processing. Build and maintain Spark batch and streaming jobs.

Implement engineering best practices including unit testing, static code analysis, and CI/CD practices.

Contribute to data platform architecture and system design decisions.

Required Skills

Core Engineering Skills

Strong Python programming expertise

Deep understanding of

- Functional programming
- Object-Oriented Programming (OOP)
- Design patterns
- Python execution and invocation mechanisms





Hands-on experience with Apache Spark / PySpark

Strong SQL expertise including

- Window functions
- Partitioning
- Query optimization

Experience building end-to-end data pipelines

Data Platform Engineering

Experience designing scalable data processing architectures

Solid understanding of distributed data processing

Familiarity with standard data pipeline engineering practices, including:

- Unit testing
- Static code analysis (Sonar or similar)
- Code linting
- Pipeline reliability and monitoring

Good to Have AWS exposure (especially EMR and S3)

Experience with Apache Airflow for job orchestration and scheduling

Exposure to Kafka or streaming architectures

Familiarity with Databricks environments (as upstream data source)

Experience working in banking, financial services, or financial crime analytics

Tech Stack

Languages: Python, SQL

Processing: Apache Spark / PySpark

Storage: Delta Tables, Parquet

Database: PostgreSQL (RDS)

Orchestration: Airflow (good to have)

Cloud: AWS (EMR, S3 good to have)

Code Quality: Sonar, Unit Testing, Linting

What We're Looking For

Strong hands-on engineer, who can do more that using standard ETL tools.

Comfortable working with large-scale datasets

Ability to design and build scalable data platform components

Someone who enjoys solving complex data engineering problems through code

📌 Data Engineer (Delhi)
🏢 Bounteous
📍 Delhi