Job Description
As a Data Engineering Lead, you play a vital role in building the right infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Ideal candidate must have at least 10 years of experience working around data management and analysis.
Practical experience delivering and supporting Cloud strategies including migrating legacy data and implementing SaaS integrations
Specialist understanding and experience of methodologies like data warehousing, data visualization and data integration
Robust experience with relational database technologies (SQL & No SQL), preferably Data Lakehouse technologies like Databricks platform
Responsibilities
· Design, develop and maintain optimal data pipelines.
· Analyze and organize raw data.
· Work closely with product managers and engineering managers to translate their needs into ETL flows.
· Assemble large, complex data sets including legacy structured data warehouse that meet functional / non-functional business requirements.
· Work with various big data platforms,
databases, and systems such as Spark, Databricks, Azure cosmos DB, SQL Server, Azure Data Factory, other big data technologies like Azure data lakes.
· Participate in data modelling discussion and influence the data architecture to ensure the best performance for solutions required by various teams.
· Solve Big Data and Distributed Data Streaming problems using latest technologies.
· Managing globally distributed data.
· Manipulate, process and extract value from large, disconnected datasets.
· Build processes supporting data transformation, data structures, metadata, dependency and workload management.
· Implement best practices to enhance data quality and reliability.
· Identify opportunities for data acquisition.
Requirements
· Bachelor’s degree in Computer Science or related field
· Expertise in setting up effective pipelines to capture data from multiple sources into the enterprise centric
📌 Job Opportunity for Data Practice Lead (India)
🏢 SRIM WORKS
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.