Education

Graduation

Experience

5+ years

Total Openings

1 New Opening

Location

Mohali

Job Description

We are looking for an experienced Senior Data Engineer to design, build, and manage scalable, reliable, and high-performance data solutions. The ideal candidate will have solid expertise in developing production-grade data pipelines, cloud data platforms, distributed processing systems, and modern data engineering practices. This role involves owning end-to-end data workflows, ensuring data quality and reliability, optimizing cloud infrastructure, and collaborating with engineering, analytics, and AI teams to deliver impactful data products.

Key Responsibilities

Build and manage production data pipelines with a focus on scalability and reliability.

Develop Python-based data engineering solutions including API integrations, automation, testing, and pipeline orchestration.

Design and optimize distributed data processing workflows using technologies such as Spark, Apache Beam, or Databricks.

Implement data partitioning, parallel processing, memory optimization,



and performance tuning strategies.

Work with cloud data platforms including AWS, Azure, or Google Cloud.

Design and maintain data warehouse solutions using Snowflake, BigQuery, Redshift, or Synapse Analytics.

Implement Infrastructure as Code using Terraform, CloudFormation, ARM/Bicep, or equivalent tools.

Develop CI/CD workflows using Git, Docker, Jenkins, GitHub Actions, or Azure DevOps.

Ensure data correctness through idempotent pipelines, deterministic deduplication, stable key generation, and validation frameworks.

Support AI/ML initiatives including NLP, LLM workflows, RAG systems, vector search, and MLOps processes (preferred).

Optimize LLM-based workflows through rate limiting, concurrency management, cost optimization, and latency improvements.

Requirements

5+ years of hands-on experience in Data Engineering with production data pipelines.

Strong expertise in Python for data engi

📌 Senior Data Engineer (Sahibzada Ajit Singh Nagar)
🏢 SourceMash Technologies
📍 Sahibzada Ajit Singh Nagar