03 Sep
|
NewVision Software
|
Pune
03 Sep
NewVision Software
Pune
Job Description
Senior BigData Engineer
n
Locations: Pune
n
Experience: 5 - 7 Years
n
Mode of Work: Hybrid
n
n
About the role:
n
Senior BigData Engineer
n
n
IF YOU ARE:
n
n
- 5+ years of industrial experience in Big Data Engineering
n
- Solid proficiency in SQL and at least one programming language: Python, Scala, or Java
n
- Hands-on experience with AWS and Snowflake
n
- Strong Experience in Data Build Tool (DBT)
n
- Experience with cloud storages: AWS S3, Azure Storage, Google Cloud Storage
n
- Practical skills with Hadoop-like environments (EMR, HDInsight, Dataproc)
n
- Experience with Big Data frameworks: Apache Spark, Databricks, Apache Flink, Apache Beam
n
- Knowledge of orchestration tools: Airflow, NiFi, AWS Glue, Azure Data Factory, Cloud Composer
n
- Experience with streaming platforms: Kafka, Kinesis, SQS, Event Hub, Pub/Sub, IoT Hub
n
- Familiarity with data warehousing and analytics: Snowflake, Redshift, Athena, Synapse
n
- Experience working with containerization & serverless technologies (Docker, Lambda, Fargate, Functions, Cloud Run)
n
- Understanding of data governance, data quality, and data lifecycle processes
n
- Strong communication and collaboration skills
n
- English at Upper?Intermediate level
n
- Bachelor’s degree in Computer Science or similar (preferred)
n
- AWS or Snowflake certifications (preferred)
n
n
n
AND YOU WANT TO:
n
n
- Design and optimize distributed computing architectures for scalable Big Data processing
n
- Build and enhance batch and streaming data pipelines
n
- Implement advanced data processing: real?time analytics, ML-driven models, predictive insights
n
- Develop reusable, parameterized ETL/ELT pipelines for DWH and lakehouse solutions
n
- Conduct end?to?end data flow validation and performance optimization
n
- Implement best practices for data quality, lineage, and governance
n
- Configure and maintain CI/CD flows and release pipelines
n
- Work with containerized and multi-container development environments
n
- Troubleshoot complex data infrastructure and processing issues
n
- Contribute to architectural decisions and technology selection
n
- Ensure secure customer data management throughout the entire project lifecycle
n
- Follow data retention, deletion, and off-boarding procedures
n
- Mentor junior engineers and support technical decision-making
n
n
📌 Senior BigData Engineer (Pune)
🏢 NewVision Software
📍 Pune