12 Sep
|
Netrolynx AI
|
India
12 Sep
Netrolynx AI
India
About The Company
Black Piano is a leading technology-driven organization specializing in cutting-edge data solutions for the energy trading and market data sectors. Committed to leveraging cutting-edge technologies, Black Piano aims to transform complex data landscapes into actionable insights, empowering clients to make informed decisions in dynamic market environments. Our company fosters a collaborative and forward-thinking culture, emphasizing continuous learning, technological excellence, and operational efficiency.
With a global presence and a focus on sustainable growth, Black Piano is dedicated to delivering high-quality services and building long-term partnerships with industry leaders.
About The Role
We are seeking a highly skilled and technically proficient Data Engineer with expertise in PySpark, real-time streaming, and trading data environments to join our dynamic team at Black Piano. The ideal candidate will possess a strong background in designing and implementing scalable, low-latency data streaming solutions tailored for energy trading, market data feeds, telemetry, and operational systems. This role involves collaborating closely with trading, risk, and operations teams to develop robust data pipelines that support real-time analytics and decision-making processes.
The successful candidate will demonstrate a security-first mindset, ownership capabilities, and the ability to translate complex business requirements into effective technical solutions, driving value for our clients and internal stakeholders alike.
Qualifications
- Proven experience in designing, building, and maintaining real-time data streaming solutions using modern event-driven architectures.
- Strong expertise in Python and PySpark for large-scale data engineering,
transformation, and analytics workloads.
- Deep understanding of low-latency data processing, especially within energy trading, market data feeds, telemetry, and operational systems.
- Experience working with data governance principles, including data quality, lineage, cataloging, security, and compliance.
- Familiarity with Medallion Architecture (Bronze, Silver, Gold) for scalable analytics platforms.
- Excellent communication skills with the ability to engage with technical and non-technical stakeholders effectively.
- Self-motivated with a demonstrated ability to work independently, take ownership, and manage multiple priorities.
- Bachelor’s degree in Computer Science, Engineering, or a related field; advanced degrees are a plus.
Responsibilities
- Design, develop, and maintain real-time streaming data pipelines utilizing modern event-driven architectures to support energy trading and operational systems.
- Optimize distributed processing workflows using Python and PySpark to ensure high performance, reliability, and scalability.
- Collaborate with trading, risk, operations, and business teams to understand their data needs and translate them into technical solutions that deliver measurable business value.
- Implement and enforce data governance standards, ensuring data quality, security, and compliance across all platforms.
- Manage and evolve Medallion Architecture (Bronze, Silver, Gold) to support scalable and trusted analytics environments.
- Embed security best practices into all aspects of data platform design, including access controls, data protection, and audit logging.
- Take ownership of end-to-end data pipeline projects, from initial design and development through deployment, monitoring, and ongoing maintenance.
- Stay updated with the latest industry trends and technologies to continually enhance data streaming capabilities and architecture.
Benefits At Black Piano, we value our employees and offer a comprehensive benefits package designed to support your professional and personal growth. Our benefits include competitive salary packages, health and wellness programs, opportunities for continuous learning and development, flexible working arrangements, and a collaborative work environment. We also provide ample opportunities for career advancement within a global organization committed to innovation and excellence.
Joining Black
Piano means becoming part of a forward-thinking team that values diversity, inclusion, and the pursuit of technological mastery.
Equal Opportunity
Black Piano is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive workplace for all employees. We do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic.
Our hiring decisions are based solely on merit, experience, and the ability to contribute to our company's success. We believe that a diverse workforce fosters innovation and drives better results for our clients and stakeholders.
📌 Backend Engineer (India)
🏢 Netrolynx AI
📍 India