5+ years of experience in Data Engineering / Warehousing
Experience in Databricks is mandatory
Experience with SQL and Python is mandatory.
Experience with Databases (Postgres/SQL Server/Oracle/MySQL) is mandatory.
Experience with AWS would be preferred.
ETL: Develop and maintain the ETL processes:
Identify, analyse, design and maintain the data sources and pipelines.
Do necessary checks to ensure that the tables loaded balances back to the operational system in terms of control totals and record counts as per Audit requirements.
Develop and maintain procedures and standards for processes e.g. (Extraction and loading of data, Coding and naming standards, Scheduling of data related scripts and jobs, Develop Change control standards)
Database maintenance:
Identifying potential improvements to the design of the database and warehouses and ETL processes.
Maintain security and access to the database.
Monitor the database and tables space usage.
Archive historical data and delete unused tables.
DB performance monitoring and performance.
Data Statistics and Reporting.
Effective Project Delivery:
Migration
Upgrades
Internal and external auditing if required.
Recent system developments and projects.
Effective project delivery - Delivery of projects on time within the agreed budgets.
Ensure Continuous Service Improvement (CSI).
Achieving Operational Excellence.
Pay: ₹1,500,000.00 - ₹2,200,000.00 per year
Education:
Bachelor's (Preferred)
Experience:
AWS Data Engineer: 7 years (Preferred)
Data Engineering : 5 years (Preferred)
Databricks: 1 year (Preferred)