15 Nov
|
Virtusa
|
Bengaluru
## Job highlights
- 5-10 years experience as Data Engineer with expertise in Data Bricks, Pyspark, Python, and Hadoop ecosystem
- Design, develop, test, deploy and maintain large-scale data pipelines; collaborate on complex data engineering projects; optimize data quality, performance, and security Roles and
Responsibilities:
- Design, develop, test, deploy and maintain large-scale data pipelines using Data Bricks, Pyspark, SQL and Python and medallion architecture
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data engineering projects.
- Develop scalable architectures for storing and processing massive datasets on cloud platforms like AWS or GCP.
- Troubleshoot issues related to data quality, performance optimization and security in production environments. Job
Requirements:
- 5-10 years of experience as a Data Engineer with expertise in Data Bricks, Pyspark and Python programming languages.
- Robust understanding of SQL concepts and ability to write efficient queries for querying large datasets.
- Experience working with big-data technologies such as Hadoop ecosystem (HDFS) is required.
📌 Data Engineer (Bengaluru)
🏢 Virtusa
📍 Bengaluru