Job Summary
This role helps extend and evolve digital products that support newsroom workflows, content discovery, and audience engagement.
Responsibilities
- Design and Develop: Develop robust data ingestion, transformation, and processing frameworks using technologies such as Databricks, Spark, Kafka, Airflow, DBT, and cloud-native services. Build and optimize data models, lakehouse architectures, and data products that serve analytics, reporting, machine learning, and operational use cases.
- Collaboration: Partner closely with product managers, analysts, data scientists, and software engineers to understand business requirements and translate them into scalable data solutions.
- Security and Governance: Ensure all data systems adhere to security, privacy, and governance requirements. Implement best practices around access controls, encryption, data lineage, and compliance.
- Documentation and Quality: Create and maintain technical design documents, data flow diagrams, source-to-target mappings, and operational runbooks.
Develop comprehensive testing strategies and automation to ensure reliability and correctness of data products.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field with at least 4+ years of experience building large-scale data engineering solutions and data platforms.
Expertise
- Databricks, Snowflake, or modern cloud-native data ecosystems.
- Python, PySpark, SQL, and distributed data processing frameworks such as Apache Spark or Flink.
- Experience building both batch and streaming data pipelines using technologies such as Kafka, Kinesis, Spark Structured Streaming, or equivalent.
- Robust understanding of dimensional modeling, data warehousing, and lakehouse architecture patterns.
- Experience with workflow orchestration platforms such as Airflow or Astronomer.
- Experience working with AWS services such as S3, Lambda, Glue, DynamoDB, Redshift, EMR, and related cloud technologies.
Skills Competenc
📌 Senior Data Engineer (Bengaluru)
🏢 Fox
📍 Bengaluru