11 Sep
|
Entiovi Technologies
|
India
11 Sep
Entiovi Technologies
India
Senior Data Engineer
About the Role
The Senior Data Engineer in our AI & Data team will be responsible for designing and building
scalable data platforms, enterprise-grade data architectures, and high-performance data
ingestion frameworks across Azure, Snowflake, Databricks, and Lakebase.
This role requires a highly technical engineer capable of solving complex data platform
challenges involving large-scale API integrations, distributed data processing, cloud-native
architectures, and AI-enabled data platforms.
The ideal candidate is not only a Data Engineer but also a solid Python engineer with expertise
in data architecture, system design, API engineering, concurrent processing, and enterprise
scale platform development.
Main Responsibilities
• Design and implement scalable enterprise data architectures supporting AI, analytics,
reporting, and operational workloads.
• Build and optimize large-scale ELT/ETL pipelines using Databricks, Snowflake, Azure Data
Factory, and Azure services.
• Design and implement Medallion Architectures (Bronze/Silver/Gold), CDC frameworks,
lineage models, and master data management workflows.
• Develop high-performance Python-based ingestion frameworks supporting large-scale
extraction from internal and external data sources.
• Build and maintain REST API and GraphQL integrations including OAuth/OAuth2
authentication, token lifecycle management, pagination, retry mechanisms, rate limiting,
and automated error recovery.
• Design parallelized ingestion solutions using multi-threading, asynchronous processing, and
distributed execution patterns.
• Develop and maintain Databricks pipelines, Delta Lake architectures, and Snowflake
analytical data platforms.
• Build and support real-time and near-real-time data processing solutions using event-driven
architectures.
• Implement data quality, reconciliation, lineage, observability, and governance frameworks
across the platform.
• Design scalable data models supporting analytics, machine learni
📌 Senior Data Engineer (India)
🏢 Entiovi Technologies
📍 India