05 Oct
|
Innovya Technologies
|
India
05 Oct
Innovya Technologies
India
Job Title: Data Engineer - Python | PySpark
Experience: 6+ years
Job Type: India, Full time, Remote
Timings: 4pm-1am IST
Innovya Technologies is a fast‑growing software consulting firm specializing in business automation and modern digital solutions. We enable organizations to accelerate value realization from their technology and transformation initiatives through expert, context‑driven product development and high‑quality engineering services.
About the Role:
We are looking for an experienced PySpark Developer with deep expertise data streaming development and deployment to join our dynamic team. A Python developer who will play a key role in maintaining, enhancing, and modernizing critical high volume and real time data pipelines. The ideal candidate will have a strong background in building scalable, fault-tolerant, and high-performance ELT applications, with a keen interest in AI enabled development.
You will work closely with cross-functional teams to design, analyse, build and deploy complex systems, providing technical direction and expertise to ensure the delivery of robust, efficient,
and scalable solutions.
Key Responsibilities:
• Design, develop, and optimize scalable data pipelines using PySpark
• Process and analyze large datasets in distributed environments
• Collaborate with data engineers, analysts, and stakeholders to deliver data solutions
• Write efficient, reusable, and reliable PySpark code
• Perform data cleansing, transformation, and validation
• Optimize Spark jobs for performance and cost efficiency
• Integrate data from various sources (databases, APIs, streaming platforms, etc.)
• Troubleshoot and debug data pipeline issues
• Maintain documentation for data workflows and processes
Required Skills:
• 6+ years of total experience in Python development, with at least 5 years in Apache Spark (PySpark).
• Hands-on experience with Python and PySpark in production data engineering environments.
• Use Spark DataFrames for large-scale data tra
📌 ?Immediate Joiner: Data Engineer (India)
🏢 Innovya Technologies
📍 India