Role Overview:
We are looking for a highly skilled and motivated Senior Data Engineer to join
our growing data engineering team.
Key Responsibilities:
In this role, you will build services that will integrate directly with
Lending Club’s products and with external vendors. you
You will work with modern data technologies such as Hadoop, Spark, DBT,
Dagster/Airflow, Atlan, Trino, etc., modern data platforms such as Databricks
and Snowflake and cloud technologies across AWS stack
Identify, design, and implement automation of manual processes, optimizing
data delivery, reducing Cloud cost, etc.
Implement processes and systems to monitor Data Quality, Observability,
Governance and Lineage.
Support operations to manage the production workplace and help in resolving
production issues with RCA
Write unit/integration tests, adopt Test-driven development, contribute to
engineering wiki, and document design/implementation etc.
Skills required:
Solid hands-on experience with distributed systems and big data
technologies, including Hadoop, Spark, Hive, DBT,
and Airflow/Dagster.
Minimum 4 years of solid production-quality coding experience in Python
focused on data pipeline development.
Experience working with cloud platforms, preferably AWS.
Experience with Databricks and/or Snowflake.
Proficiency in Git, JIRA, Jenkins, and shell scripting.
Good understanding of Agile methodologies, source control management, test
automation, and Test-Driven Development.
Experience working with cross-functional teams in fast-paced and dynamic
environments.
Strong analytical, collaborative problem-solving, and communication skills.
Proven track record of building quick, scalable, reliable, and high-quality
data pipelines.
Nice to Have:
Experience building data pipelines for Digital Marketing use cases.
Required Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field, or
equivalent practical experience.
6+ years of experie
📌 Manager Gurugram
🏢 EXL
📍 Gurugram