- Design, implement, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure SQL Data Lake Storage.
- Provide database support administration services including monitoring performance metrics such as CPU usage, memory consumption, and disk utilization for optimal system health.
- Collaborate with cross-functional teams to identify business requirements and develop solutions that meet those needs through the use of Oracle ADF tools.
- Troubleshoot issues related to data pipeline failures or errors by analyzing logs files and debugging techniques.
Job Requirements :
- 7-15 years of experience in IT Services & Consulting industry with expertise in cloud computing platforms like Microsoft Azure.
- Solid understanding of Oracle ADF (Oracle Advanced Data Fusion) concepts including its architecture, features, and best practices.
- Experience working with big data technologies such as Hadoop Distributed File System (HDFS), Spark Core/Scala programming languages.
- Proficiency in managing large-scale databases on Azure SQL Data Base Administration.