Apply on Kit Job: kitjob.in/job/4321lh

OverviewWe are looking for a

Senior Big Data Analyst with 8–12 years

of experience to design and operate modern, cloud‑native data pipelines on AWS. The role involves building scalable ETL workflows, developing high‑performance Spark jobs, automating infrastructure with Terraform, and ensuring strong data quality, security, and monitoring. You’ll collaborate with global, cross‑functional teams, support production systems, optimize cloud costs, and drive engineering best practices in an agile environment.

Key ResponsibilitiesDesign, build, test, deploy, and maintain scalable, cloud‑native ETL and data pipelines.Translate business and ML requirements into technical designs, data models, and reliable datasets with defined SLAs.Work hands‑on with AWS services including

S3, EMR, Glue, Lambda, Kafka, Step Functions, Athena, Redshift .Develop and optimize

Spark

jobs using

Scala or PySpark

for batch and streaming workloads.Automate cloud infrastructure using

Terraform

or Ansible.Build CI/CD pipelines with automated testing, linting, and code/security scanning using

SonarQube .Write clean, testable

Python and SQL

code with unit, integration, and end‑to‑end tests.Implement IAM roles, encryption, data masking, governance frameworks, and compliance controls.Set up monitoring using logs, metrics,



and tracing; troubleshoot issues and perform RCA.Participate in on‑call rotations and ensure the reliability of production pipelines.Collaborate with analysts, data scientists, product owners, and international teams using Jira and Confluence.Prepare architecture diagrams, runbooks, onboarding documents, and post‑incident reports.Mentor team members and conduct code reviews.Drive cloud cost optimization through partitioning strategies, architecture improvements, and workflow tuning.Manage version control, releases, rollbacks, and safe deployments across environments.

Required Skills & Experience8–12 years

of experience in Data Engineering, Big Data, or Data Warehousing.Proven expertise in designing and deploying cloud‑native data pipelines.Deep hands‑on experience with

AWS : EMR, Glue, Lambda, S3, Kafka, Step Functions, Athena, Redshift.Strong Spark programming skills in

Scala or PySpark .Solid proficiency in

Python and SQL .Experience with

Terraform

(or Ansible) for cloud automation.Hands‑on with

Docker ; exposure to Kubernetes or Nomad is a plus.Experience integrating

SonarQube

or similar tools into CI/CD pipelines.Strong understanding of IAM, encryption, data protection, and cloud security practices.Experience working in Agile environments using

Jira, Confluence, GitHub .Experience in international/global teams is an added advantage.Strong software engineering fundamentals, documentation skills, and ability to mentor peers.

Apply on Kit Job: kitjob.in/job/4321lh

📌 Big Data Developer (New Delhi)
🏢 BSH Home Appliances India
📍 New Delhi