Job Description
Candidates ready to join immediately can share their details via email for quick processing.
nCCTC | ECTC | Notice Period | Location Preference
nAct fast for immediate attention ⏳
nMust-Have Skills
n
n
6+ years of overall experience in Data Engineering / Big Data.n
Strong understanding of Big Data concepts and architecture .n
Strong hands-on experience with Apache Spark .n
Expertise in:n
Spark Performance Tuningn
Spark Optimizationn
Query/Job Performance Improvementn
Troubleshooting Spark workloadsn
Strong hands-on experience with PySpark and Spark .n
Robust programming experience in Python .n
Good experience working with MySQL / SQL .n
Solid experience in designing and developing Data Pipelines .n
Hands-on experience with Apache Airflow for data pipeline orchestration and scheduling.n
Experience working with at least one Cloud Platform .n
GCP experience is preferred. n
Positive understanding of CI/CD and DevOps concepts .n
Experience integrating data engineering workloads with CI/CD pipelines.n
Strong debugging, troubleshooting, and problem-solving skills.n
nPreferred Skills
n
n
Hands-on exposure to relevant GCP data services .n
Experience handling large-scale and high-volume datasets.n
Understanding of distributed data processing and data architecture.n
Experience improving the scalability, reliability, and performance of data pipelines.n
Exposure to Agile development and DevOps practices.n
nKey Responsibilities
n
n
Design, develop, and maintain scalable Big Data and Data Engineering solutions .n
Develop data processing applications using Python, PySpark, and Apache Spark .n
Perform Spark performance tuning and optimization for large-scale workloads.n
Build, maintain, and monitor robust ETL/ELT data pipelines .n
Develop and manage workflow orchestration using Apache Airflow .n
Work with MySQL/SQL for data extraction, transformation, and validation.
📌 6 + Yoe Data Engineer Big Data / Pyspark Any Ust Location Immediate Joiner Bengaluru (India)
🏢 UST
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.