Platform Data Engineer (Hyderabad)

Platform Data Engineer (Hyderabad)

18 Sep
|
NovusPlatform.io
|
Hyderabad

18 Sep

NovusPlatform.io

Hyderabad

Company Description

- NovusPlatform.io is a service startup revolutionizing the traditional IT ecosystem with expertise in cutting-edge technologies.
- We are looking for Senior Platform Engineers who can actively support our platform engineering team.

Duties and Responsibilities:- Must Do:-

- Showcase the ability to learn new technologies at a fast pace, as the technology stack in the Data team evolves very rapidly.
- You should be ready to move out of your comfort zone and face new challenges.
- While onboarding the new stack, think 365 degrees, and consider all scenarios in usage/reusability, scalability, deployment, integration, maintenance, and automation.
- Showcase strong proficiency in programming in 1 language (Python, Scala, Java, or any) and showcase the ability to learn new languages if required by a new technology stack.
- Showcase ability to build and maintain ETL pipelines and data-driven systems using any Data Tech example - Apache Spark, AWS Glue, Athena, Redshift, AWS Batch.
- Showcase a strong grip on writing complex SQL queries.
- Develop code on GitHub with end-to-end knowledge of advanced git operations, such as git-flow, rebasing, and squashing.

Should be able to learn and implement:-

- Should be able to implement Infra as code using Terraform
- Should be able to learn and use AWS Analytics and Data Services like Glue, S3, Lambda, AWS Batch, Athena, Redshift, Dynamo DB, Cloudwatch, Kinesis, SQS, SNS, and DMS




- Using Jenkins to implement deployment pipelines.
- Do requirements gathering and come up with estimated efforts for onboarding the new stack
- Design and Architect the various tools for ML, Data Governance, Deployment/Integration Automation, Data Analytics

Try to:- Learn other AWS services like - ECS, ECR, EC2

Learn Data Modeling

Requirements:- Past Job Experience-

- A total of 5-9 years of experience in software development with at least 5 years of experience in building scalable and stable data pipelines in the AWS tech stack.

- Prior experience in building Data Pipelines in AWS Cloud. (In job experience or personal side projects)

Data and AWS Tools:-

Must have:

- Robust proficiency with any programming language (Python, Scala, Java)

- Strong proficiency with SQL
- Experience with 3 or more of the following AWS Analytics Ecosystem - Apache Airflow, Apache Spark, S3, Glue, Kafka, AWS Athena, Lambda, Redshift, Lake formation, AWS Batch, ECS - Fargate, Kinesis, Flink, DynamoDB, Sagemaker
- Should have experience in using IaC while deploying the Data Pipelines in AWS. Examples - Terraform, Cloudformation, etc.

Highly Desired:-

- Experience in Docker, Kubernetes, ECR, EC2, VPC, SNS, SQS, Cloudwatch
- Experience in building Jenkins deployment pipelines.
- Experience in collaboration tools like JIRA, Confluence, GitHub

Good to have:-

Exposure to NoSQL databases

📌 Platform Data Engineer (Hyderabad)
🏢 NovusPlatform.io
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: platform data engineer (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: platform data engineer (hyderabad) / hyderabad