19 Nov
|
CodeVyasa
|
Bengaluru
19 Nov
CodeVyasa
Bengaluru
We are seeking a skilled Data Engineer ,Bangalore having 2+ yrs of experience.
About Us
CodeVyasa is a mid-sized product engineering company that works with top-tier product and solutions organizations such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are a team of 550+ engineers, driving innovation across Product & Data Engineering, focusing on Agentic AI, RPA, Full Stack, and GenAI-based solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Write effective Python scripts for data extraction, transformation, and processing.
- Develop complex SQL queries involving joins, aggregations, transformations, and query optimisation.
- Build and maintain data processing workflows using Apache Spark/PySpark or similar distributed processing frameworks.
- Work with batch and streaming data processing requirements.
- Implement data modelling practices, including partitioning and schema evolution.
- Ensure data quality, consistency, and reliability across pipelines.
- Monitor production data pipelines, troubleshoot failures, and implement error-handling mechanisms.
- Maintain logging, monitoring, and production support processes.
- Collaborate with cross-functional teams to deliver reliable data engineering solutions.
Mandatory Skills
1. Python: Strong programming and scripting skills.
2. SQL: Hands-on experience with joins, aggregations, transformations, and query optimisation.
3. Apache Spark / PySpark: Experience with distributed data processing frameworks.
4. ETL/ELT Pipelines: Experience building and maintaining production-grade data pipelines.
5. Batch & Streaming: Working knowledge of batch and streaming data processing concepts.
6. Data Modelling: Understanding of partitioning, schema evolution, and data quality practices.
7. Production Support: Experience with monitoring, logging, error handling, and troubleshooting data pipelines.
Why Join CodeVyasa?
- Work on innovative, high-impact projects with leading global clients.
- Exposure to modern technologies, scalable systems, and cloud-native architectures.
- Continuous learning and upskilling opportunities through internal and external programs.
- Supportive and collaborative work culture with flexible policies.
- Competitive salary and comprehensive benefits package.
- Free healthcare coverage for employees and dependents.
📌 Data Engineer (Bengaluru)
🏢 CodeVyasa
📍 Bengaluru