Development,
maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes
with thorough knowledge of star/snowflake schemas
Hands
on experience in PowerCenter Developer/IDMC/IICS Data Integration
Experience
in DW Production Support / troubleshooting data or pipeline issues
Developing
complex SQL queries and SQL optimization
Development
experience must be full Life Cycle experience including business
requirements gathering, data sourcing, testing/data reconciliation, and
deployment within Business Intelligence/Data Warehousing Architecture.
Designing
and implementing data security
Monitoring
and optimizing data storage and data processing
Use of
Object function/object -oriented scripting languages including Scala, C++,
Java and Python
Cloud
data warehouse and data lake platforms (e.g., Snowflake, Databricks,
Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)
Working knowledge of message queuing, stream processing, and highly
scalable ‘big data’ data stores.
Robust
project management and organizational skills.
Experience




supporting and working with cross -functional teams in a dynamic
workplace.
Understanding
of data science concepts
Familiarity
with AI/ML frameworks and libraries

Requirements
•
Developing data services that are fit for purpose, resilient, scalable, and
future proof, to meet user needs

•
Advanced SQL knowledge and experience working with relational databases and
working familiarity with various databases.

•
Demonstrated understanding and experience using software and tools including
ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and
Hadoop

•
Experience building and optimizing ‘big data’ data pipelines, architecture, and
data sets.

•
Experience performing root cause analysis on internal and external data and
processes to answer specific business questions and identify opportunities for
improvement.

•
Robust analytic skills related to working with unstructured datasets.

📌 Sr Data Engineer Pune
🏢 Excelencia Itech Consulting
📍 Pune