17 Nov
|
Innovya Technologies
|
India
17 Nov
Innovya Technologies
India
Company Description Innovya Technologies is focused on accelerating business value from technology and digital initiatives for clients across diverse industries. The team quickly understands each client’s context and drives end-to-end product and feature development. Innovya operates in key segments including RPA deployments, game development, web and mobile applications, and cloud implementations.
The company values practical innovation, technical excellence, and close collaboration with clients to deliver measurable outcomes.
Role Description This is a full-time remote role for a Sr.
Databricks
Engineer specializing in Databricks, PySpark, and Python. The role involves designing, building, and optimizing data pipelines and ETL processes on Databricks, including configuration, performance tuning, and monitoring of data workflows. The engineer will develop scalable data solutions using PySpark and Python, integrate data from multiple sources, and ensure data quality, reliability, and security.
Day-to-day responsibilities include collaborating with product, analytics, and engineering teams to understand data requirements, implementing best practices for data engineering and cloud usage, documenting technical designs, and providing support for deployed data solutions. The role also includes mentoring peers, contributing to architecture decisions, and staying current with emerging tools and patterns in the big data ecosystem.
Qualifications
- Solid hands-on experience with Databricks,
including workspace management, cluster configuration, jobs, notebooks, and integration with cloud storage and data services.
- Advanced proficiency in PySpark and Python for building distributed data processing pipelines, ETL workflows, and data transformations on large-scale datasets.
- Solid understanding of data engineering concepts such as data modeling, partitioning, optimization, and performance tuning in big data environments.
- Experience with cloud platforms (such as AWS, Azure, or GCP), including data storage services, security, networking basics, and CI/CD for data solutions.
- Familiarity with SQL and relational/non-relational databases, including writing efficient queries, working with schema design, and managing data access.
- Knowledge of software engineering best practices, including version control (e.g., Git), testing, code review, and documentation for data pipelines.
- Ability to collaborate with cross-functional teams, translate business requirements into technical designs, and communicate clearly with both technical and non-technical stakeholders.
- Previous experience in a senior or lead data engineering role and a track record of delivering production-grade data solutions; experience mentoring others is beneficial.
- Bachelor’s or master’s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
📌 Sr. Databricks Engineer- Databricks/PySpark/Python (India)
🏢 Innovya Technologies
📍 India