Candidates ready to join immediately can share their details via email for quick processing. CCTC | ECTC | Notice Period | Location Preference [email protected] Act rapid for immediate attention! ⏳ ___ Must-Have Skills - 6+ years of overall experience in Data Engineering / Big Data. - Strong understanding of Big Data concepts and architecture. - Strong hands-on experience with Apache Spark. - Expertise in: - Spark Performance Tuning - Spark Optimization - Query/Job Performance Improvement - Troubleshooting Spark workloads - Strong hands-on experience with PySpark and Spark. - Strong programming experience in Python. - Good experience working with MySQL / SQL. - Strong experience in designing and developing Data Pipelines. - Hands-on experience with Apache Airflow for data pipeline orchestration and scheduling. - Experience working with at least one Cloud Platform. - GCP experience is preferred. - Good understanding of CI/CD and DevOps concepts. - Experience integrating data engineering workloads with CI/CD pipelines. - Strong debugging, troubleshooting, and problem-solving skills. Preferred Skills - Hands-on exposure to relevant GCP data services. - Experience handling large-scale and high-volume datasets.
- Understanding of distributed data processing and data architecture. - Experience improving the scalability, reliability, and performance of data pipelines. - Exposure to Agile development and DevOps practices. Key Responsibilities - Design, develop, and maintain scalable Big Data and Data Engineering solutions. - Develop data processing applications using Python, PySpark, and Apache Spark. - Perform Spark performance tuning and optimization for large-scale workloads. - Build, maintain, and monitor robust ETL/ELT data pipelines. - Develop and manage workflow orchestration using Apache Airflow. - Work with MySQL/SQL for data extraction, transformation, and validation. - Deploy and support data engineering solutions in cloud environments, preferably GCP. - Work with DevOps teams to implement and maintain CI/CD pipelines. - Troubleshoot production issues and optimize data processing performance. - Collaborate with engineering and business teams to deliver reliable and scalable data solutions. Primary Skill Combination Big Data + Apache Spark + PySpark + Python + Airflow + SQL/MySQL + Cloud (GCP Preferred) + CI/CD Mandatory Focus: Strong hands-on Apache Spark performance tuning and optimization experience.
📌 6 + YoE - Data Engineer - Big Data / PySpark - any UST Location - Immediate Joiner (Bengaluru)
🏢 UST
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.