Job DescriptionCandidates ready to join immediately can share their details via email for quick processing.
NCCTC | ECTC | Notice Period | Location Preference
[email protected]
NAct fast for immediate attention
N
NMust-Have Skills
n
- N
- 6+ years of overall experience in Data Engineering / Big Data. N
- Strong understanding ofBig Data concepts and architecture. N
- Strong hands-on experience with Apache Spark. N
- Expertise in: N
- Spark Performance Tuning N
- Spark Optimizationn
- Query/Job Performance Improvement N
- Troubleshooting Spark workloads N
- Strong hands-on experience with PySpark and Spark. N
- Strong programming experience in Python. N
- Good experience workingwith MySQL / SQL. N
- Solid experience in designing and developing Data Pipelines. N
- Hands-on experience with Apache Airflow for data pipeline orchestration and scheduling. N
- Experience working withat least one Cloud Platform. N
- GCP experience is preferred. N
- Good understanding of CI/CD and DevOps concepts. N




- Experience integrating data engineering workloads with CI/CD pipelines. N
- Strong debugging, troubleshooting, and problem-solving skills. N

nPreferred Skills
N
- n
- Hands-on exposureto relevant GCP data services. N
- Experience handling large-scale and high-volume datasets. N
- Understanding of distributed data processing and data architecture. N
- Experience improving the scalability, reliability, and performance of data pipelines. N
- Exposure to Agile development and DevOps practices. N

nKey Responsibilities
N
- n
- Design, develop, and maintain scalable Big Data and Data Engineering solutions. N
- Develop data processingapplications using Python, PySpark, and Apache Spark. N
- Perform Spark performance tuning and optimization for large-scale workloads. N
- Build, maintain, and monitor robust ETL/ELT data pipelines. N
- Develop and manage workflow orchestration using Apache Airflow. N
- Work with MySQL/SQL fordata extrac

📌 Hiring: 6 + Yoe (Karnataka)
🏢 UST
📍 Karnataka