Role Overview:
We are looking for a highly skilled and motivated Senior Data Engineer to join our growing data engineering team.
Key Responsibilities:
•
In this role, you will build services that will integrate directly with client’s products and with external vendors. you
•
You will work with contemporary data technologies such as Hadoop, Spark, DBT, Dagster/Airflow, Atlan, Trino, etc., modern data platforms such as Databricks and Snowflake and cloud technologies across AWS stack
•
Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc.
•
Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage.
•
Support operations to manage the production environment and help in resolving production issues with RCA
•
Write unit/integration tests, adopt Test-driven development, contribute to engineering wiki, and document design/implementation etc.
Skills required:
•
Strong hands-on experience with distributed systems and big data technologies, including Hadoop, Spark, Hive, DBT,
and Airflow/Dagster.
•
Minimum 7 years of solid production-quality coding experience in Python focused on data pipeline development.
•
Experience working with cloud platforms, preferably AWS.
•
Experience with Databricks and/or Snowflake.
•
Proficiency in Git, JIRA, Jenkins, and shell scripting.
•
Good understanding of Agile methodologies, source control management, test automation, and Test-Driven Development.
•
Experience working with cross-functional teams in fast-paced and dynamic environments.
•
Strong analytical, collaborative problem-solving, and communication skills.
•
Proven track record of building fast, scalable, reliable, and high-quality data pipelines.
Nice to Have :
Experience building data pipelines for Digital Marketing use cases.
Required Qualifications :
•
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experien
📌 Lead Assistant Manager (Pune)
🏢 EXL
📍 Pune