Apply on Kit Job: kitjob.in/job/4b8drb

Primary Roles and Responsibilities

n

Developing Modern Data Warehouse solutions using Databricks and Azure Stack

n

Ability to provide solutions that are forward-thinking in data engineering and analytics space

n

Collaborate with DW/BI leads to understand current ETL pipeline development requirements

n

Triage issues to find gaps in existing pipelines and fix the issues

n

Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

n

Help joiner team members to resolve issues and technical challenges

n

Drive technical discussion with client architect and team members

n

Orchestrate the data pipelines in scheduler via Airflow

n

Skills and Qualifications

n

Bachelor's and/or master’s degree in computer science or equivalent experience

n

Must have total 6+ yrs. of IT experience and 4+ years' experience in Data warehouse/ETL projects

n

Deep understanding of Star and Snowflake dimensional modelling

n

Strong knowledge of Data Management principles

n

Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

n

Should have hands-on experience in SQL, Python and Spark (PySpark)

n





Candidate must have experience in Azure stack

n

Desirable to have ETL with batch and streaming (Kinesis)

n

Experience in building ETL / data warehouse transformation processes

n

Experience with Apache Kafka for use with streaming data / event-based data

n

Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

n

Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

n

Experience working with structured and unstructured data including imaging & geospatial data

n

Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT

n

Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

n

Databricks Certified Data Engineer Associate/Professional Certification (Desirable)

n

Comfortable working in a energetic, fast-paced, innovative environment with several ongoing concurrent projects

n

Should have experience working in Agile methodology

n

Robust verbal and written communication skills

Apply on Kit Job: kitjob.in/job/4b8drb

📌 Senior Engineer, Data Engineering Chennai
🏢 Important Group
📍 Chennai