Key Responsibilities

1. Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF)

2. Configure and manage Linked Services, Datasets, and Pipelines in ADF

3. Develop and optimize data transformation workflows using Azure Databricks (PySpark)

4. Work across Lakehouse architecture layers (Bronze/Silver/Gold), storage accounts, Unity Catalog, and support metadatau2011driven design (control tables, mappings).

5. Strong technical expertise across Power BI, SQL, Power Platform tools, and Azure services

6. Build and manage dbt models for data transformation, testing, and documentation

7. Implement real-time data ingestion using Azure Event Hub

8. Integrate data from multiple sources (databases, APIs, cloud storage, on-prem systems)

9.



Ensure data quality by implementing dbt tests and validations

10. Monitor, troubleshoot, and optimize data workflows

11. Collaborate with cross-functional teams to understand business data requirements

12. Maintain data governance, security, and performance standards

13. Solid understanding of data warehousing concepts and ELT methodologies

14. Experience working with Azure Data Lake Storage (ADLS) or similar storage solutions

15. Knowledge of version control (Git) and CI/CD processes

16. Willing to work in production support

📌 Data Scientist II (Hyderabad)
🏢 Conduent
📍 Hyderabad