About The Company Black Piano is a leading technology-driven organization specializing in advanced data solutions for the energy trading sector. Our company is committed to delivering innovative, scalable, and secure data platforms that empower trading, risk management, and operational teams to make informed decisions in a fast-paced market environment.

With a focus on leveraging cutting-edge technologies and fostering a team-oriented culture, Black Piano strives to set industry standards in data engineering and analytics.

About The Role We are seeking a highly skilled Data Engineer with a strong background in real-time streaming data and PySpark to join our dynamic team. The ideal candidate will have proven experience designing, building, and maintaining low-latency data streaming solutions, particularly within the context of energy trading and market data feeds.

This role requires a combination of technical expertise, business acumen, and a security-first mindset to develop robust data platforms that support critical trading operations. As part of our team, you will collaborate closely with trading, risk, and operational teams to translate complex business requirements into scalable technical solutions, ensuring data integrity, security, and compliance at every stage.

Qualifications

- Proven experience in designing and implementing real-time data streaming solutions using modern event-driven architectures.
- Strong proficiency in Python and PySpark for large-scale data processing, transformation, and analytics workloads.
- Deep understanding of low-latency data processing, especially in energy trading,



telemetry, and operational systems.
- Experience with data governance principles, including data quality, lineage, cataloging, and security.
- Familiarity with Medallion Architecture (Bronze, Silver, Gold) for building scalable and trusted analytics platforms.
- Excellent communication skills with the ability to engage stakeholders and translate business needs into technical solutions.
- Demonstrated ability to work independently, take ownership of projects, and deliver results in a fast-paced environment.
- Knowledge of security best practices in data engineering, including access controls, data protection, and compliance requirements.

Responsibilities

- Design, develop, and maintain real-time data streaming solutions to support energy trading and operational analytics.
- Optimize distributed processing pipelines using Python and PySpark, ensuring high performance and reliability.
- Collaborate with trading, risk, and operations teams to understand their data needs and deliver scalable solutions.
- Implement data governance frameworks, ensuring data quality, lineage, and security are maintained across platforms.
- Manage and support Medallion Architecture-based data pipelines,



ensuring data is trusted and readily available for analytics.
- Embed security principles into all aspects of data platform design, including access controls and data protection measures.
- Take ownership of projects from conception through deployment and ongoing operational support.
- Continuously evaluate emerging technologies and industry best practices to enhance data solutions.

Benefits At Black Piano, we offer a comprehensive benefits package designed to support our employees’ well-being and professional growth. Our offerings include competitive salary packages, health insurance, retirement plans, and paid time off. We promote a flexible work environment that encourages work-life balance and provide opportunities for continuous learning and development. Additionally, our collaborative culture fosters innovation and recognizes individual contributions, ensuring our team remains motivated and engaged. We also support remote work arrangements where applicable, allowing employees to work from locations that best suit their lifestyles.

Equal Opportunity

Black Piano is an equal opportunity employer committed to fostering an inclusive and diverse workplace. We do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, religion, or any other protected characteristic. We believe that diverse perspectives and backgrounds drive innovation and excellence, and we are dedicated to providing an equitable environment where all employees can thrive and contribute to our shared success.

📌 Data Engineer (India)
🏢 FetchJobs.co
📍 India