Walk-in Drive | PySpark Data Engineer | Bangalore | 8th August
Are you passionate about Big Data, PySpark, and AWS technologies?
Join us for an exciting Walk-in Drive and be a part of a dynamic Data Engineering team working on cutting-edge cloud and big data solutions.
Position: PySpark Data Engineer
Location: Bangalore
Walk-in Date: 8th August
Experience Required: 5 - 10 Years
Required Technical Skills
- Python Programming
- PySpark
- Big Data Technologies
- Hadoop Ecosystem
- Hive, Impala
- SQL
-
Key Responsibilities
- Design, develop, and optimize scalable data pipelines using PySpark and Big Data technologies.
- Work on enterprise-level Data Engineering and Data Analytics projects.
- Develop and maintain ETL processes for large-scale datasets.
- Analyze and troubleshoot Spark jobs using Spark UI and performance tuning techniques.
- Write effective SQL queries involving joins, subqueries, CTEs, and complex data transformations.
- Collaborate with cross-functional teams to understand business requirements and deliver data solutions.
- Work with AWS cloud services including EMR, S3, Lambda, SNS, SQS, IAM, and Redshift.
- Implement best practices for data quality, governance, and performance optimization.