Sr Developer role in a global media and entertainment environment focusing on advanced data engineering solutions using PySpark in a hybrid work model. The candidate will design optimize and support data pipelines that power content analytics audience insights and revenue reporting while collaborating with cross functional teams to drive measurable impact on business decisions and viewer experiences.
Responsibilities
Design effective PySpark based data pipelines that ingest transform and prepare large scale media and entertainment data sets to support analytics and reporting for content performance and audience engagement.
Develop reusable PySpark frameworks and modules that standardize data processing for streaming metrics viewership trends recommendation inputs and campaign attribution across multiple media platforms.
Optimize PySpark jobs by refining partitioning strategies caching resource configurations and query logic to improve reliability processing speed and cost efficiency in large data environments.
Collaborate with product data science and business stakeholders in media and entertainment to translate analytical needs into scalable PySpark solutions that support audience insights and content valuation.
Implement robust data quality checks validation rules and monitoring mechanisms in PySpark workflows to ensure accuracy of key performance indicators for ratings engagement and revenue metrics.
Integrate data from diverse media sources including streaming logs ad servers customer profiles and content catalogs into unified PySpark based datasets that enable comprehensive analysis and reporting.
Maintain clear technical documentation for PySpark pipelines data models and operational procedures to support knowledge sharing and smooth onboarding for other developers and analysts.
Troubleshoot production issues in PySpark jobs and related data workflows by performing root cause analysis applying fixes and implementing preventive enhancements to im