Roles and Responsibility
Design, develop, and implement scalable and productive data processing pipelines using Kafka.
Collaborate with cross-functional teams to identify and prioritize project requirements.
Develop and maintain technical documentation for data pipelines and architectures.
Troubleshoot and resolve complex issues related to data processing and system integration.
Ensure compliance with industry standards and best practices for data security and quality.
Participate in code reviews and contribute to the improvement of the overall codebase.
Job Requirements
Solid understanding of Kafka, Debezium, and Oracle 19c/21c technologies.
Proficiency in SQL, PL/SQL, Linux, Shell Scripting, and other relevant programming languages.
Experience with cloud-based platforms such as AWS and containerization tools like Kubernetes.
Knowledge of data lake architecture and data bricks concepts.
Familiarity with agile development methodologies and version control systems.
Excellent problem-solving skills and attention to detail.