- Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies.
- The Tech Lead should be highly proficient in the use of Big Data / Open-Source Technologies and standard techniques of Data Integration, Data Manipulation.
- Should be able to design and develop cost productive and performant data pipelines in the cloud platform
- Create data environment to support our data analytics, reporting and data science teams
- Experience with integration of data from multiple data sources
- Knowledge of various Data Pipeline techniques and frameworks
- Performance optimization - need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution.
- Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need