16 Aug
|
Innovya Technologies
|
India
16 Aug
Innovya Technologies
India
Company Overview:
Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions. We help businesses quickly realize value from their technology and digital initiatives by delivering expert, context-driven product development.
Cultural Fit:
At Innovya, we thrive in a fast-paced, supportive environment where continuous learning, teamwork, and disciplined execution are key. If you're results-driven, growth-minded, and eager to make an impact, Innovya is the place for you
About the Role:
We are looking for an experienced PySpark Developer with deep expertise data streaming development and deployment to join our dynamic team. A Python developer who will play a key role in maintaining, enhancing, and modernizing critical high volume and real time data pipelines. The ideal candidate will have a robust background in building scalable, fault-tolerant, and high-performance ELT applications, with a keen interest in AI enabled development.
You will work closely with cross-functional teams to design, analyse,
build and deploy complex systems, providing technical direction and expertise to ensure the delivery of robust, efficient, and scalable solutions.
Key Responsibilities:
- Design, develop, and optimize scalable data pipelines using PySpark
- Process and analyze large datasets in distributed environments
- Collaborate with data engineers, analysts, and stakeholders to deliver data solutions
- Write efficient, reusable, and reliable PySpark code
- Perform data cleansing, transformation, and validation
- Optimize Spark jobs for performance and cost efficiency
- Integrate data from various sources (databases, APIs, streaming platforms, etc.)
- Troubleshoot and debug data pipeline issues
- Maintain documentation for data workflows and processes
Required Skills:
- 4+ years of total experience in Python development, with at least 2 years in Apache Spark (PySpark).
- Hands-on experience with Python and PySp
📌 Azure Databricks Data Engineer (India)
🏢 Innovya Technologies
📍 India