Phenom Intro:
Our purpose is to help a billion people find the right job Phenom is an AI-Powered talent experience platform that is redefining the HR tech space. We have grown into a global organization with offices in 6 countries and over 2,000 employees. As an HR tech unicorn organization, innovation and creativity is within our DNA. Come help us make every talent moment Phenomenal
Job Summar
y Phenom People is looking for an experienced Data Engineer to optimize and enhance our data pipelines that power insights across the organization. This role focuses on improving performance, ensuring data quality, automating pipeline development, and enabling data sharing through scalable and secure mechanisms
. The ideal candidate will have strong expertise in Py Spark, SQL optimization, and experience with data sharing platforms such as Data Hub. You'll collaborate closely with data engineering, platform, and analytics teams to modernize our data ecosystem built on Airflow, Livy, EMR, Flink, Iceberg, and Snowflake
. If you're passionate about performance tuning, automation,



and building resilient data systems — we'd love to hear from you
.
What You'll
Do Optimize existing data pipelines built using Py Spark for performance and scalabilit y. Review and tune SQL queries to improve execution time and resource utilizatio n. Design and develop recent batch data pipelines that meet evolving business needs (real-time decisioning is not required; systems can tolerate up to 6 hours of delay ). Automate pipeline generation and metadata management to streamline developmen t. Implement data quality and validation frameworks to ensure reliability and trust in data asset s. Collaborate with teams to integrate and share data via Data Hub, leveraging connectors such as SFTP and Snowflake Data Shar e. Enhance observability by integrating and monitoring pipelines through Grafana and other telemetry tool s. Work closely with other engineers to improve coding practices and leverage AI-powered de

📌 Data engineer (Hyderabad)
🏢 Phenom
📍 Hyderabad