About The Company

Black Piano is a leading technology firm specializing in innovative data solutions for the energy trading sector. With a focus on delivering high-performance, scalable, and secure data platforms, Black Piano empowers its clients to make data-driven decisions in a fast-paced and highly regulated industry. Our commitment to excellence, innovation, and integrity has established us as a trusted partner for energy companies seeking to optimize their trading operations through advanced analytics and real-time data processing.

About The Role

We are seeking a highly skilled Data Engineer with expertise in PySpark, real-time streaming, and trading data environments to join our agile team. In this role, you will be responsible for designing, developing, and maintaining real-time data streaming solutions that support our energy trading clients. Your work will directly impact the efficiency and accuracy of trading operations by enabling rapid data ingestion, processing, and analysis.

You will collaborate closely with trading, risk management, operations, and business teams to translate complex requirements into scalable technical solutions. The ideal candidate will have a strong background in event-driven architectures, data governance, and security principles, with a proactive approach to problem-solving and ownership of projects from conception through deployment.

Qualifications

- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Software Engineering, or a related field.
- Proven experience in designing and implementing real-time data streaming solutions using modern event-driven architectures.




- Strong proficiency in Python and PySpark for large-scale data processing and analytics.
- Experience working with low-latency data processing, particularly in energy trading, market data feeds, telemetry, or operational systems.
- Deep understanding of data governance principles, including data quality, lineage, cataloging, security, and compliance standards.
- Hands-on experience with Medallion Architecture (Bronze, Silver, Gold layers) for building scalable analytics platforms.
- Excellent communication skills with the ability to engage stakeholders and translate business needs into technical solutions.
- Ability to work independently, demonstrate ownership, and manage multiple priorities effectively.

Responsibilities

- Design, develop, and maintain real-time data streaming pipelines using PySpark and related technologies.
- Implement low-latency data processing solutions to support energy trading and operational decision-making.
- Collaborate with trading, risk, and operations teams to understand data requirements and deliver scalable solutions.
- Ensure data quality, integrity, and security across all data platforms, adhering to governance standards.
- Implement and manage Medallion Architecture (Bronze, Silver, Gold) to facilitate trusted and scalable analytics.




- Embed security best practices into data platform design, including access controls, data protection, and auditing.
- Monitor, troubleshoot, and optimize data pipelines to ensure high performance and reliability.
- Take ownership of projects from design to deployment, providing ongoing support and enhancements.

Benefits Black Piano offers a comprehensive benefits package designed to support our employees’ well-being and professional growth. Our offerings include competitive salary packages, health insurance, retirement plans, and paid time off. We also provide opportunities for continuous learning and development through training programs, certifications, and participation in industry conferences. Our flexible work environment promotes work-life balance, and we foster a collaborative culture that values innovation, diversity, and inclusion. Additionally, employees have access to wellness programs, employee assistance programs, and other resources aimed at ensuring a healthy and engaging workplace experience.

Equal Opportunity

Black Piano is an equal chance employer committed to creating an inclusive environment for all employees. We celebrate diversity and are dedicated to fostering a workplace where everyone feels valued, respected, and empowered. We do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic.

Our hiring practices are designed to ensure fairness and equal opportunity for all applicants, and we actively seek to build a diverse workforce that reflects the communities we serve.

📌 Data Engineer (India)
🏢 FetchJobs.co
📍 India