Key Responsibilities:
Design, develop, and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform.
Utilize Hadoop for productive data storage and Hive+Impala for data querying and processing.
Ensure the reliability, scalability, and performance of data operations.
Implement best practices for data management, including data quality, data governance, and data security.
Monitor and troubleshoot data pipelines to ensure smooth data flow and timely resolution of issues.
Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
Automate data workflows and processes to enhance operational efficiency.
Develop and maintain documentation related to data engineering and operations processes.
Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
5+ Years of experience in data engineering and data operations, preferably in the banking sector.
Robust knowledge of Oracle Flexcube, APIs, JDBC/ODBC connection, SQL, Python, Spark (PySpark), Cloudera Data Platform, Hadoop, Hive, and Impala.
Cloud knowledge is a plus.
Proven experience in designing and managing data pipelines.
Excellent analytical and problem-solving skills.
📌 Data Engineer With Data Operations Kolkata
🏢 Important Company of the Sector
📍 Kolkata
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.