Candidates
ready to join immediately
can share their details via email for quick processing.
?
CCTC | ECTC | Notice Period | Location Preference
[email protected]
Act fast for immediate attention ⏳?
___________________________________________________________________________________________________
Must-Have Skills
- 6+ years
of overall experience in Data Engineering / Big Data.
- Strong understanding of
Big Data concepts and architecture
.
- Strong hands-on experience with
Apache Spark
.
- Expertise in:
- Spark Performance Tuning
- Spark Optimization
- Query/Job Performance Improvement
- Troubleshooting Spark workloads
- Strong hands-on experience with
PySpark and Spark
.
- Strong programming experience in
Python
.
- Good experience working with
MySQL / SQL
.
- Strong experience in designing and developing
Data Pipelines
.
- Hands-on experience with
Apache Airflow
for data pipeline orchestration and scheduling.
- Experience working with at least one
Cloud Platform
.
- GCP experience is preferred.
- Good understanding of
CI/CD and DevOps concepts
.
- Experience integrating data engineering workloads with CI/CD pipelines.
- Solid debugging, troubleshooting, and problem-solving skills.
Preferred Skills
- Hands-on exposure to relevant
GCP data services
.
- Experience handling large-scale and high-volume datasets.
- Understanding of distributed data processing and data architecture.
- Experience improving the scalability, reliability, and performance of data pipelines.
- Exposure to Agile development and DevOps practices.
Key Responsibilities
- Design, develop, and maintain scalable
Big Data and Data Engineering solutions
.
- Develop data processing applications using
Python, PySpark, and Apache Spark
.
- Perform
Spark performance tuning and optimization
for large-scale workloads.
- Build, maintain, and monitor robust
ETL/ELT data pipelines
.
- Develop and manage
📌 6 + YoE - Data Engineer – Big Data / PySpark - any UST Location - Immediate Joiner (Bengaluru)
🏢 UST
📍 Bengaluru