Job Description

Senior BigData Engineer

n

Locations: Pune

n

Experience: 5 - 7 Years

n

Mode of Work: Hybrid

n

n

About the role:

n

Senior BigData Engineer

n

n

IF YOU ARE:

n

n
5+ years of industrial experience in Big Data Engineering
n
Solid proficiency in SQL and at least one programming language: Python, Scala, or Java
n
Hands-on experience with AWS and Snowflake
n
Robust Experience in Data Build Tool (DBT)
n
Experience with cloud storages: AWS S3, Azure Storage, Google Cloud Storage
n
Practical skills with Hadoop-like environments (EMR, HDInsight, Dataproc)
n
Experience with Big Data frameworks: Apache Spark, Databricks, Apache Flink, Apache Beam
n
Knowledge of orchestration tools: Airflow, NiFi, AWS Glue, Azure Data Factory, Cloud Composer
n
Experience with streaming platforms: Kafka, Kinesis, SQS, Event Hub, Pub/Sub, IoT Hub
n
Familiarity with data warehousing and analytics: Snowflake, Redshift, Athena, Synapse
n
Experience working with containerization & serverless technologies (Docker, Lambda, Fargate, Functions, Cloud Run)
n
Understanding of data governance, data quality, and data lifecycle processes
n
Robust communication and collaboration skills
n




English at Upper?Intermediate level
n
Bachelor’s degree in Computer Science or similar (preferred)
n
AWS or Snowflake certifications (preferred)
n

n

n

AND YOU WANT TO:

n

n
Design and optimize distributed computing architectures for scalable Big Data processing
n
Build and enhance batch and streaming data pipelines
n
Implement advanced data processing: real?time analytics, ML-driven models, predictive insights
n
Develop reusable, parameterized ETL/ELT pipelines for DWH and lakehouse solutions
n
Conduct end?to?end data flow validation and performance optimization
n
Implement best practices for data quality, lineage, and governance
n
Configure and maintain CI/CD flows and release pipelines
n
Work with containerized and multi-container development environments
n
Troubleshoot complex data infrastructure and processing issues
n
Contribute to architectural decisions and technology selection
n
Ensure secure customer data management throughout the entire project lifecycle
n
Follow data retention, deletion, and off-boarding procedures
n
Mentor junior engineers and support technical decision-making
n

n

📌 Senior Bigdata Engineer Pune
🏢 NewVision Software
📍 Pune