We are looking for a skilled Python & PySpark Developer with strong expertise in Big Data technologies, Spark, SQL/PL-SQL, and REST API development using Flask or Django. The ideal candidate should have experience building scalable data pipelines, processing large datasets, developing APIs, and working with distributed computing frameworks.

Key Responsibilities

- Develop, optimize, and maintain scalable data pipelines using PySpark and Apache Spark.
- Design, develop, and optimize complex SQL and PL/SQL queries, stored procedures, functions, and database objects.
- Build and maintain RESTful APIs using Flask or Django.
- Develop robust Python applications for data engineering and backend services.
- Process and analyze large-scale datasets using Big Data technologies.
- Optimize Spark jobs for performance, scalability, and reliability.
- Integrate APIs with internal and external systems.
- Collaborate with cross-functional teams including Data Engineers, Data Scientists, and Application Developers.
- Troubleshoot production issues and implement performance improvements.
- Follow coding standards, version control, and CI/CD best practices.

Mandatory Skills

- Strong proficiency in Python programming.
- Hands-on experience with PySpark and Apache Spark.
- Solid SQL coding skills.
- Experience with PL/SQL development.
- Experience in Big Data ecosystem.




- REST API development using Flask or Django.
- Experience in developing and consuming Python APIs.
- Knowledge of data processing, ETL, and distributed computing.
- Experience with Git/version control.

Preferred Skills

- Experience with Hadoop ecosystem (Hive, HDFS, YARN).
- Exposure to cloud platforms such as AWS, Azure, or GCP.
- Knowledge of Airflow or other workflow orchestration tools.
- Experience with Docker and Kubernetes.
- Familiarity with Kafka or other streaming technologies.
- Understanding of CI/CD pipelines.

Qualifications

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 4–8+ years of experience in Python and Big Data development (can be adjusted based on the role).

Required Experience

- Strong hands-on experience in Python, PySpark, and Apache Spark.
- Extensive experience writing optimized SQL and PL/SQL code.
- Experience developing REST APIs using Flask or Django.
- Experience working with large-scale data processing and ETL pipelines.
- Strong analytical, debugging, and problem-solving skills.

Mandatory Skills: Python, PySpark, SQL Coding, Apache Spark, Big Data, Flask/Django (REST API), PL/SQL, Python APIs.

Skills:- Python, PySpark, SQL and Apache Spark

📌 Data Engineer (Bengaluru)
🏢 VY SYSTEMS PRIVATE
📍 Bengaluru