- Understanding business processesunderstanding the software systems for retrievalprepping and modelling data to build/maintain modern data platform for supporting reports and Dashboards.
- Create and maintain optimal data pipeline architecture.
- Assemble largecomplex data sets that meet functional/non-functional business requirements.
- Identifydesignand implement internal process improvements: automating manual processesoptimizing data deliveryre-designing infrastructure for greater scalabilityetc.
- Build the infrastructure required for optimal extractiontransformationand loading of data from a wide variety of data sources using Azure technologies.
- Work with stakeholders including the ProductDataand Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Education
- B.E. or B.Tech
Experience
- 3 to 6 Yrs as Data Engineer Knowledge & Skills
- Experience of working on any of the public cloud AWS/Azure/GCP
- Experience working on Python/Scala/JavaBig Data technologies like spark and Hadoop File System (HDFS)
- Robust hands-on experience in writing code in Pyspark/Python/Scala/Shell language using best practices.
- Experience on Performance tuning of Spark Jobs and cluster configurations
- Any one
- Proficient in writing highly optimized SQL s and algorithm for data processing
- Sound understanding of the cloud relational and non-relation databasetheir storage conceptsbest practices and use case.
- Knowledge in RESTful WebserviceMicrosoft SQL ServerMySQL Serverand Agile methodology is an advantage.
- DevOps toolchain experience is plus (Docker/Kubernetes/Ansible/Git)
- Strong analyticalproblem-solvingand communication skills
- Excellent command of both written and spoken English.
- Should be able to DesignDevelopDeliver & maintain Data Infrastructures.
Disclaimer: This job posting has been aggregated from external source. Role detailscontentand availability are subject to change.
Applicants are advised to confirm the latest information directly on the company website before applying.