Job Description

About the Role

We are looking for a highly capable and hands-on Senior Software Engineer to join our Data Ingestion team. In this role, you will be a core contributor responsible for building, optimizing, and maintaining scalable data pipelines and backend systems.

You will work closely with our Lead Engineers and Product Managers to translate technical designs into production-ready code. Because we process high volumes of data, you will be tasked with writing efficient code, troubleshooting performance bottlenecks (CPU/Memory), and ensuring data flows reliably through our ETL pipelines. This is an excellent opportunity for a solid engineer who thrives in an Agile environment and loves solving complex data transfer challenges.

Key Responsibilities

- Core Development: Design, write, test, and deploy clean, scalable code primarily in Java or Python.

- Pipeline Engineering: Build and maintain high-throughput data ingestion workflows, ETL pipelines, and data formatting/analytics processes.

- System Optimization: Actively monitor application performance, troubleshoot memory and CPU consumption issues, and optimize database queries and data transfer bottlenecks.

- Technical Collaboration: Participate heavily in system design discussions, conduct thorough code reviews, and provide constructive feedback to peers.

- Infrastructure & Deployment: Work hands-on with AWS cloud infrastructure,



Kubernetes deployments, and CI/CD pipelines to ensure smooth and reliable releases.

- Agile Execution: Actively participate in Scrum ceremonies (sprint planning, stand-ups, retrospectives) and take ownership of delivering complex features on time.

- Mentorship: Provide guidance and support to junior Software Engineers on the team.

Technical Requirements

Core Backend & Data Engineering:

- Languages: Strong, hands-on proficiency in Java and Python.

- Data & Big Data: Solid experience building ETL pipelines and working with Apache Spark and data formatting/analytics tools.

- Databases: Proficient in designing schemas and writing optimized queries for both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB, Cassandra) databases.

- Messaging/Queues: Experience integrating and troubleshooting message brokers and event queues (e.g., Kafka, AWS SQS, RabbitMQ).

Cloud & Infrastructure:

- Cloud Platform: Proven experience building and deploying applications on AWS (e.g., S3, EC2, Lambda, RDS).

- DevOps & CI/CD: Experience utilizing deployment pipelines via GitLab or Jenkins.

- Containerization: Practical experience with Docker and deploying/managing applications in Kubernetes (K8s).

- Infrastructure as Code (IaC): Basic understanding or hands-on exposure to IaC tools (e.g., Terraform, AWS CloudFormation).

📌 Member Technical Staff II (Bengaluru)
🏢 The Nielsen
📍 Bengaluru