Lead PySpark Engineer (Bengaluru)

Lead PySpark Engineer (Bengaluru)

23 Oct
|
Orcapod Consulting Services
|
Bengaluru

23 Oct

Orcapod Consulting Services

Bengaluru

Location: BENGALURU

Type: CONTRACTUAL

EXP:6+ years

IMMEDIATE JOINERS

Mandatory Skills

- PySpark and Python

- Apache Spark Internals

- Distributed Systems Architecture

- Spark Performance Tuning and Memory Optimization

- Delta Lake, Parquet, Trino

- Data Partitioning and Partition Pruning

- Join Optimization, Window Functions, and Time-Series Processing

- Catalyst Optimizer and Adaptive Query Execution (AQE)

- Spark UI, Explain Plans, Event Logs, and Performance Metrics

- Linux and vi Commands

- Apache Airflow

- MinIO

- Kubernetes and Containerized Deployments

- Git and Azure DevOps (ADO)

- VS Code and GitHub Copilot

- Scalable Batch and Near Real-Time Data Pipelines

- Reusable Spark Framework Development

- Technical Leadership, Code Reviews, and Production Incident Resolution

If comfortable with C2H then send resume to [email protected]

📌 Lead PySpark Engineer (Bengaluru)
🏢 Orcapod Consulting Services
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead pyspark engineer (bengaluru) / bengaluru