- Bachelors Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
• Maintains close awareness of recent and emerging technologies and their potential application for service offerings and products.
- Work with architect and lead engineers for solutions to meet functional and non functional requirements.
- Demonstrated knowledge of relevant industry trends and standards.
• Demonstrate strong analytical and technical problem-solving skills.
• Must have excellent coding skills either Python or Scala, preferably Python.
• Must have experience in Data Engineering domain .
• Must have at least experience on databricks which consists of various components as below
• Must have skills:
Azure data factory, Azure data bricks, Python and Pyspark
• Expert with database technologies and ETL tools.
• Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.
• Good knowledge of AZURE, AWS, GCP Cloud platform services stack
• Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Delta lake, Databricks workflows orchestration, Python, Pyspark etc.