13 Oct
|
Infosys
|
Hyderabad
:
Position: ADF, Databricks, PySpark Engineer
Location: Bangalore, Trivandrum
Roles & Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
- Build scalable data processing solutions using Azure Databricks, Python, and PySpark.
- Develop ETL/ELT workflows for data ingestion, transformation, and loading.
- Work with Azure Data Lake Storage (ADLS), Azure SQL, and other Azure data services.
- Optimize Spark jobs and Databricks notebooks for performance and scalability.
- Implement data quality checks, validation rules, and monitoring processes.
- Create and manage end-to-end data integration solutions across multiple data sources.
- Collaborate with business stakeholders and data teams to understand data requirements.
- Troubleshoot and resolve data pipeline and performance issues.
- Follow coding standards, version control, and CI/CD best practices.
- Support data warehousing and analytics initiatives.
- Prepare technical documentation and maintain deployment artifacts.
Role: Data Science & Analytics - Other, Industry Type: IT Services & Consulting, Department: Data Science & Analytics, Employment Type: Full Time, Permanent Role Category: Data Science & Analytics - Other Education UG: B.Tech / B.E. in Any Specialization PG: MS/M.Sc(Science) in Any Specialization, MBA/PGDM in Any Specialization, MCA in Any Specialization Key Skills Skills highlighted with ‘‘ are preferred keyskills PySparkAzure DatabricksAzure Data Factory (ADF) ETL/ELT DevelopmentSQLApache SparkGitAzure Data Lake Storage (ADLS)Azure Synapse AnalyticsDelta LakeData WarehousingData ModelingPython
📌 Azure Data Factory Developer (Hyderabad)
🏢 Infosys
📍 Hyderabad