18 Nov
|
CodeVyasa
|
Bengaluru
18 Nov
CodeVyasa
Bengaluru
Job Description
We are seeking a skilled Data Engineer ,Bangalore having 2+ yrs of experience.
About Us
CodeVyasa is a mid-sized product engineering company that works with top-tier product and solutions organizations such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are a team of 550+ engineers, driving innovation across Product & Data Engineering, focusing on Agentic AI, RPA, Full Stack, and GenAI-based solutions.
Key Responsibilities
• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Write effective Python scripts for data extraction, transformation, and processing.
• Develop complex SQL queries involving joins, aggregations, transformations, and query optimisation.
• Build and maintain data processing workflows using Apache Spark/PySpark or similar distributed processing frameworks.
• Work with batch and streaming data processing requirements.
• Implement data modelling practices, including partitioning and schema evolution.
• Ensure data quality, consistency, and reliability across pipelines.
• Monitor production data pipelines, troubleshoot failures, and implement error-handling mechanisms.
• Maintain logging, monitoring, and production support processes.
• Collaborate with cross-functional teams to deliver reliable data engineering solutions. Mandatory Skills
• Python: Strong programming and scripting skills.
• SQL: Hands-on experience with joins, aggregations, transformations, and query optimisation.
• Apache Spark / PySpark: Experience with distributed data processing frameworks.
• ETL/ELT Pipelines: Experience building and maintaining production-grade data pipelines.
• Batch & Streaming: Working knowledge of batch and streaming data processing concepts.
• Data Modelling: Understanding of partitioning, schema evolution, and data quality practices.
• Production Support: Experience with monitoring, logging, error handling, and troubleshooting data pipelines. Why Join CodeVyasa?
• Work on innovative, high-impact projects with leading global clients.
• Exposure to modern technologies, scalable systems, and cloud-native architectures.
• Continuous learning and upskilling opportunities through internal and external programs.
• Supportive and collaborative work culture with flexible policies.
• Competitive salary and comprehensive benefits package.
• Free healthcare coverage for employees and dependents.
📌 Data Engineer (Bengaluru)
🏢 CodeVyasa
📍 Bengaluru