Summary:
As a Custom Software Engineer, a typical day involves designing and developing tailored software solutions that enhance various system components or applications. The role requires working within energetic project environments, applying modern development methodologies to ensure the delivery of scalable and efficient software. Collaboration with cross-functional teams is a key aspect, enabling the integration of cutting-edge features that meet specific business requirements. Continuous improvement and adaptation to evolving technologies are integral to the daily workflow, ensuring that solutions remain robust and aligned with organizational goals.
Roles & Responsibilities:
- Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead efforts to identify and implement best practices within the team to enhance productivity and quality.
- Facilitate knowledge sharing and mentoring to support the growth and development of team members.
- Coordinate with stakeholders to align software development activities with business objectives.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in PySpark.
- Experience in developing scalable data processing pipelines using PySpark with extensive experience in design, build and deployment of Python-based applications with Experience in various AWS services such as EMR, API Gateway, RDS instance, and Lambda.
- Strong understanding of distributed computing concepts and big data frameworks.
- Ability to optimize PySpark jobs for performance and resource utilization.
- Familiarity with integrating PySpark solutions into larger software ecosystems.
- Experience with debugging and troubleshooting complex data workflows.
- Should hands-on experience in relational databases preferably Oracle and PostgreSQL and writing complex SQL queries.
- Ability to understand complex data sets and ETL processes, and how they can be optimized using Spark and to Collaborate with other teams to integrate Spark jobs into the overall data pipeline.
- Knowledge of Java and Snowflake would be an added advantage.
- Should Monitor and tune data loads and queries.
Additional Information:
- The candidate should have minimum 5+ years of overall IT experience, which includes building & deployment of Bigdata applications using PySpark and AWS cloud.
- This position is based at our Bengaluru office.
- A 15 years full time education is required."
📌 Pyspark-Banglore (India)
🏢 Objectwin Technology India
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.