Data pipeline development o Design, build and maintain scalable ETL (Extract, Transform, Load)
o Automate data ingestion from multiple sources (APIs, database, files, etc.).
- Data Storage & Management
o Develop and optimize data storage solutions (e.g. datalakes, warehoures) o Ensure data integrity, consistency and security across systems.
o Work with Azure cloud storage
- Data Processing & Transformation
o Process and clean raw data for analysis and visualization report o Implement real-time and batch data processing workflows using Spark, Kafka
- Database Management
o Design and optimize relations (SQL) and NoSQL databases. o Improve database performance indexing, and query optimization
- Data Governance & Security
o Implement Data quality, validation and governance standards. o Ensure compliance with data privacy
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.