Job Description
We're looking for someone very tech-savvy, with PySpark experience, real-time streaming, and ideally experience with trading data/teams.
n

nStreaming Data Expertise
n
- n
- Proven experience designing, building, and maintaining real-time data streaming solutions using contemporary event-driven architectures.n
- Strong understanding of low-latency data processing for energy trading, market data feeds, telemetry, and operational systems.n

n

nPython & PySpark Proficiency
n
- n
- Advanced hands-on experience with Python and PySpark for large-scale data engineering, transformation, and analytics workloads.n
- Ability to optimize distributed processing pipelines and develop robust, production-grade data solutions.n

n

nBusiness Engagement & Solution Design
n
- n
- Strong communication and stakeholder management skills with the ability to translate complex business requirements into scalable technical solutions.n
- Experience working directly with trading, risk, operations, and business teams to deliver measurable business value.n

n





nData Governance & Medallion Architecture
n
- n
- Deep understanding of data governance principles, including data quality, lineage, cataloging, security, and compliance.n
- Proven experience implementing and managing Medallion Architecture (Bronze, Silver, Gold) to support trusted and scalable analytics platforms.n

n

nSecurity-First Engineering Mindset
n
- n
- Designs and implements data platforms based on rigorous security principles, including least-privilege access, data protection, auditing, and regulatory compliance.n
- Ensures security is embedded throughout the data lifecycle and solution architecture.n

n

nIndependent Delivery & Ownership
n
- n
- Self-motivated and capable of working independently with minimal supervision.n
- Demonstrates strong ownership, problem-solving ability, and the capacity to drive initiatives from design through implementation and operational support.n

n

📌 Senior Data Engineer (Raipur)
🏢 Black Piano
📍 Raipur