Let's grow together Senior Data Engineer Education Graduation

Experience 5+ years

Total Openings 1 New Opening

Location Mohali

We are looking for an experienced Senior Data Engineer to design, build, and manage scalable, reliable, and high-performance data solutions. The ideal candidate will have strong expertise in developing production-grade data pipelines, cloud data platforms, distributed processing systems, and modern data engineering practices. This role involves owning end-to-end data workflows, ensuring data quality and reliability, optimizing cloud infrastructure, and collaborating with engineering, analytics, and AI teams to deliver impactful data products.

Key Responsibilities

- Build and manage production data pipelines with a focus on scalability and reliability.
- Develop Python-based data engineering solutions including API integrations, automation, testing, and pipeline orchestration.
- Design and optimize distributed data processing workflows using technologies such as Spark, Apache Beam, or Databricks.
- Implement data partitioning, parallel processing, memory optimization, and performance tuning strategies.
- Work with cloud data platforms including AWS, Azure, or Google Cloud.
- Design and maintain data warehouse solutions using Snowflake, BigQuery, Redshift, or Synapse Analytics.
- Implement Infrastructure as Code using Terraform, CloudFormation, ARM/Bicep, or equivalent tools.
- Develop CI/CD workflows using Git, Docker, Jenkins, GitHub Actions, or Azure DevOps.
- Ensure data correctness through idempotent pipelines, deterministic deduplication, secure key generation, and validation frameworks.




- Support AI/ML initiatives including NLP, LLM workflows, RAG systems, vector search, and MLOps processes (preferred).
- Optimize LLM-based workflows through rate limiting, concurrency management, cost optimization, and latency improvements.

Requirements

- 5+ years of hands-on experience in Data Engineering with production data pipelines.
- Strong expertise in Python for data engineering applications.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Strong knowledge of cloud data warehouses including Snowflake, BigQuery, Redshift, or Synapse Analytics.
- Hands-on experience with distributed data processing frameworks such as Spark, Apache Beam, Databricks, or similar technologies.
- Strong understanding of data partitioning, shuffling, windowing operations, parallel processing, and memory optimization.
- Experience with Docker, Git workflows, automated testing, CI/CD pipelines, and deployment processes.
- Experience implementing Infrastructure as Code solutions using Terraform, CloudFormation, ARM, or Bicep.
- Strong understanding of data quality, reliability, and production system design principles.
- Experience with ML/NLP engineering, LLMs, RAG, vector databases, or MLOps is preferred.
- Ability to design scalable architectures while ensuring downstream system stability and performance.
- Maintain records of the conversations with the customer and analyze the data.
- Handling customer queries on Chat and E-mails.

Career First Name Last Name Email Contact No Job Applied For Preferred Location Mohali Experience (Years) Notice Period (In Days) Curriculum Vitae/Resume *

📌 Senior Data Engineer (Sahibzada Ajit Singh Nagar)
🏢 SourceMash
📍 Sahibzada Ajit Singh Nagar