Role Overview: As a Senior Data Engineer you will be working in end to end development of scalable Big Data pipelines and Data streams and manage various data related objectives such as system configuration and integration on multiple platforms
On a typical day you will:
As a Data Engineer you will be working with one of the largest and most complex warehouse environments
Coordinate with key stakeholders and ensure effective design, development, validation in line with the stakeholder needs and architectural requirements
End to end development of scalable Big Data pipelines and Data streams
Manage various data related objectives such as system configuration and integration on multiple platforms
Develop key metrics for tests on data and ensure integrity of same on data architecture
Adhere to proper documentation based on each of the development activities
Work with huge data sets and exhibit problem solving, analytical and communication abilities
Will be working in a self-directed setting, take up responsibilities and drive them to completion
What you will Need to be Successful:
Problem solving, analytical and valuable communication abilities
Years of development experience with Azure Cloud and Big Data Analytic solutions
Hands on experience in Azure - Data Factory, Data Lake store/Blob storage, SQL DB
Experience in creating Big data Pipelines with Azure components
Positive programming skills in Java, Scala or Python
SQL experience writing stored procedures, tuning indexes and troubleshooting performance bottlenecks
Advanced experience with Data Warehousing concepts and standards
Experience with ETL processing or ETL toolset
Data Management concepts and standards (SQL Server, Oracle, Cloud, Hadoop, etc.)
Experience with Big Data Solutions. Hive, Spark or other frameworks
Experience across cloud implementations and Solutions specially Microsoft Azure
Exposure to large databases, BI applications, data quality and performance tuning.
Practical knowledge of Linux or Unix, a plus
Experience in Snowflake (cloud data warehouse), a plus
Experience with MS Dynamics data integration and development, a plus
Experience with Oracle - JDE ERP, a plus
Role: Data Engineer
Industry Type: Financial Services
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: Any Graduate
PG: Any Postgraduate
📌 Senior Data Engineer Bengaluru
🏢 Otis
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.