10 Oct
|
Virtusa
|
Hyderabad
Job Requirements
JP - UHGJP00126453
Role - Data Engineer
Number of RRIDs required - 5
JD - Description
Please list the required skills and attributes for this role, including expected years of experience where applicable.
Core Data Engineering: 5+ years of experience designing, building, and optimizing robust, scalable data pipelines
Programming Languages: 4+ years of robust production-grade coding experience in Python and advanced proficiency writing complex, optimized SQL queries
Big Data Technologies: 3+ years of experience working with distributed computing frameworks such as Apache Spark (or PySpark).
Data Warehousing Architecture: Advanced proficiency in cloud data platforms (such as Snowflake, Google BigQuery, or AWS Redshift) and building optimized dimensional models
Problem-Solving Data Quality: Proven track record of implementing rigorous data validation data cleansing, and error-handling frameworks
Please list the preferred skills and attributes for this role, including expected years of experience where applicable.
Cloud Infrastructure:
2+ years of hands-on experience with cloud platforms particularly with managed data services and serverless computing
Orchestration Tools: Experience managing and monitoring complex workflows using tools like Apache Airflow, Prefect, or dbt.
CI/CD & DevOps: Experience deploying pipelines via CI/CD frameworks and infrastructure-as-code
Streaming Architecture: Familiarity with real-time data streaming technologies such as Apache Kafka or AWS Kinesis is a strong plus.
Primary Responsibilities
Pipeline Development Design build and maintain automated scalable ETL/ELT pipelines ingesting high-volume data from disparate sources.
Data Modeling Optimization: Build clean relational and dimensional data models supporting self-service analytics and BI workloads.
Performance Tuning: Monitor troubleshoot and optimize data workflows and queries for speed, cost-efficiency, and reliability.
Collaboration Integration: P
📌 Data engineer (Hyderabad)
🏢 Virtusa
📍 Hyderabad