We are looking for a Lead Data Engineer to join our Content Tech Big Data Engineering Team in India. This is an amazing opportunity to work on Real Wor l d Data using big data technologies.

W e would love to speak with you if you have skills in Python, Spark and have experience on building big data platforms.

About You - experience, education, skills, and accomplishments
Bachelor s Degree or equivalent in computer science, software engineering, or a related field
At least 5 y ears of r elevant e xperience .
Valuable experience working with Python, Py S park , AWS, AWS Glue, EMR and Delta Lake.
Positive knowledge of ETL, including the ability to read and write efficient, robust code, follow or implement best practices and coding standards, design/implement common ETL strategies (CDC, SCD, etc.), and create reusable/maintainable jobs.
Solid background in database systems (such as Postgres, Oracle, Snowflake /Databricks ) along with strong knowledge of PL/SQL and SQL.
Experience in handling large volume of data and building data pipelines.
Possess good knowledge of Agile/other SDLC methodologies.
Exposure to a Data warehouse / BI project in a Healthcare Domain .
Strong oral and written communication skills .

It would be outstanding if you also had . . .
Familiarity with
s would be added advantage.




Experience in building big data platforms.
Understanding on healthcare data.

What will you be doing in this role

As a member of Data Engineering Team, you ll Step into a key role on an expanding data engineering team to build our data platforms, data pipelines, and data transformation capabilities.
Define and implement our data platform strategy on Cloud, have a meaningful impact on our customers, and working in our high energy, innovative, quick-paced Agile culture.
Drive rapid prototyping and development with Product and Technical teams in building and scaling high-value medical data capabilities.
Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using Apache suite (airflow, spark), SQL, Python, ETL, and AWS big data technologies.
Creation and support of batch and real-time data pipelines and ongoing data monitoring and validation built on AWS/Snowflake/Apache technologies for medical data from many different sources.
Conduct functional and non-functional testing, writing test scenarios and test scripts.
Evaluate existing applications to update and add new features to meet business requirements.
-

📌 Lead Software Engineer Data Engineer Bengaluru
🏢 Clarivate
📍 Bengaluru