- ADF Data Engineers Duties and Responsibilities Development / Enhancement of existing ETL Pipelines Build schedules, events, or manual invocation for the ETL Pipelines Define the data transformation and data flow activities as required Build data model, data transformation needs, data integrity & constraints, indexing, performance needs
- - Documentation related to pipeline build and data model & configuration Accommodate future requirements and deliverables while working on similar features in tool
- - Tool establishing connections to databases, master / service ID creations on DB level
- - Establishing and migration of Job schedules Establishing and migration of Job dependencies Upper workplace creation Defining Service Execution Process Document, System Maintenance Technical Document, SLAs & Performance Metrics Continuous Job Monitoring Incident/ Bug Resolution, Minor Enhancements Code Deployment to upper environments Support Scheduled refreshes to ensure on ti