09 Sep
|
VARITE
|
Bengaluru
Company Name: VARITE India Private Limited
About The Client:
Client is an Indian multinational technology company specializing in information technology services and consulting. Headquartered in Mumbai, it is a part of the Tata Group and operates in 150 locations across 46 countries.
Essential Job Functions:
- Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources to ensure seamless data flow and accessibility.
- Collaborate with cross-functional teams to integrate data from multiple disparate sources, ensuring consistency, accuracy, and reliability of data.
- Optimize data processing workflows and storage solutions for performance, scalability, and cost-efficiency
- Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle.
- Monitor the performance of data pipelines and infrastructure, identifying and resolving issues to maintain system stability and reliability.
Qualifications:
- Experience: 6+ yrs.
Must-Have(Ideally should not be more than 3-5)
- Expertise in Google Data Engineering services – Big Query, Dataproc etc
- Strong experience in programming languages such as Python, PySpark data manipulation and engineering tasks.
- Expertise in SQL and NoSQL databases
- In-depth knowledge of data warehousing solutions
- Deep understanding on data warehousing concepts
- Proficiency in designing, developing, and maintaining ETL (Extract, Transform, Load) processes using tools like Apache Airflow, Talend, or Informatica.
Good-to-Have(Ideally should not be more than 3-5)
- Understanding of DevOps Concepts in GCP.
- Solid understanding of data modeling concepts and techniques to create efficient and scalable data models.
- Experience with version control systems such as Git for code management and collaboration.
- Knowledge of data governance, data quality standards, and data security practices to ensure complia
📌 GCP Big Query, Dataproc, Pub Sub, Airflow (Bengaluru)
🏢 VARITE
📍 Bengaluru