06 Aug
|
Cognosin
|
Thiruvananthapuram
06 Aug
Cognosin
Thiruvananthapuram
Job Title: Senior Data Engineer Experience Level: 8–10 years Number of Positions: 1 Location: Trivandrum (Hybrid) Job Role / We are looking for a Senior Data Engineer responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data Platform and SQL Server (SSIS, SSAS, UC4 Atomic). The role involves working closely with stakeholders to ensure efficient data processing, storage, and retrieval at scale.
Roles And Responsibilities Design, build, and maintain scalable, reliable data pipelines.
Develop ETL solutions using Azure Data Factory, Databricks, and SSIS.
Analyze the existing data landscape and suggest rearchitecting or optimization strategies.
Collaborate with onshore teams to resolve technical challenges and requirements.
Monitor, troubleshoot, and optimize data systems for performance and reliability.
Ensure data architecture aligns with business goals and governance policies.
Integrate and transform data from diverse sources with high data quality.
Lead data engineering strategy and architecture discussions.
Enable and manage data migrations across systems.
Perform thorough testing and validation of data transformations.
Define data mappings and translate business processes into technical data requirements.
Manage pipeline maintenance, testing, and performance validation.
Build large, complex data sets to meet business needs.
Analyze and identify data gaps; align business and IT on data requirements.
Collaborate with IT, DevOps, and cross-functional teams for infrastructure alignment.
Implement best practices for data security, privacy, and continuous improvement.
Manage complex cases accurately and efficiently in high-volume environments.
Candidate Profile Expectations
Proficient in designing solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services.
Robust hands-on experience in SSIS, SQL, query optimization, and ETL pipelines.
Worked in onshore–offshore model, managing complex scenarios.
Skilled in handling large structured/unstructured data, analytics, and data science.
Experience with Azure and AWS cloud services, and DevOps/CI/CD tools.
Comfortable working with ambiguous requirements and delivering clear outcomes.
Strong communication skills; detail-oriented and self-driven.
Experience with Terraform, Jenkins, and Infrastructure as Code (IaC).
Contributed to architecture frameworks and data warehouse design.
Solid understanding of full data lifecycle: ingestion, transformation, loading, validation, tuning.
Experience in Python and Databricks is a plus. Must-Have Skills Azure Data Factory
Azure Databricks
Azure Synapse
ADLS
Lakehouse Architecture
Python
SCD Concepts and Implementation
SQL, PL/SQL
SSIS
SSAS
TFS Good-to-Have Skills UC4
Power BI
DevOps CI/CD
Banking Domain
📌 Senior Data Engineer (Thiruvananthapuram)
🏢 Cognosin
📍 Thiruvananthapuram