08 Aug
|
Sagacious Infosystems
|
India
08 Aug
Sagacious Infosystems
India
Position: Data Engineer
Experience: 4–8 Years
Location: Bangalore
Employment Type: Full time
Job Summary
We are looking for a skilled Data Engineer to build and maintain scalable data pipelines, improve data quality, and develop solutions for record matching and identity resolution. The ideal candidate should have robust experience in Python, SQL, PySpark, Databricks/Snowflake, and modern data engineering practices. You will work with large Business, Consumer, and Healthcare datasets to create accurate, reliable, and high-performing data solutions.
Key Responsibilities
Design and develop scalable ETL/ELT data pipelines.
Process, clean, and transform large datasets.
Build and maintain data models and databases.
Perform data deduplication and identity resolution.
Optimize SQL queries and improve data processing performance.
Ensure data quality, accuracy, and consistency across multiple sources.
Develop and maintain workflows using Databricks, Spark, or cloud platforms.
Collaborate with Data Scientists, Analysts, and Engineering teams.
Implement data security, governance, and privacy best practices.
Troubleshoot and resolve data pipeline issues.
Required Skills
Solid experience in Python and Advanced SQL
Hands-on experience with PySpark
Experience with Databricks or Snowflake
Good understanding of ETL/ELT processes
Experience with Data Modeling and Data Warehousing
Knowledge of Data Quality and Data Validation
Experience working with large structured and unstructured datasets
Familiarity with Git and version control
Experience with Azure or AWS is preferred
Nice to Have
Experience in Entity Resolution or Record Linkage
Knowledge of Master Data Management (MDM)
Understanding of Identity Resolution techniques
Experience with Airflow, Prefect, or Dagster
Knowledge of Healthcare, Consumer, or Business data domains
Pay: ₹510,705.92 - ₹1,000,000.00 per year
Work Location: In person
📌 Data Engineer Entity Resolution / Data Engineering Hrbr Layout (India)
🏢 Sagacious Infosystems
📍 India