- Design, develop, and implement scalable and efficient data processing pipelines using Kafka.
- Collaborate with cross-functional teams to identify and prioritize project requirements.
- Develop and maintain technical documentation for data pipelines and architectures.
- Troubleshoot and resolve complex issues related to data processing and system integration.
- Ensure compliance with industry standards and best practices for data security and quality.
- Participate in code reviews and contribute to the improvement of the overall codebase.
Job Requirements
- Solid understanding of Kafka, Debezium, and Oracle 19c/21c technologies.
- Proficiency in SQL, PL/SQL, Linux, Shell Scripting, and other relevant programming languages.
- Experience with cloud-based platforms such as AWS and containerization tools like Kubernetes.
- Knowledge of data lake architecture and data bricks concepts.
- Familiarity with agile development methodologies and version control systems.
- Excellent problem-solving skills and attention to detail.