01 Sep
|
NewVision Software
|
Pune
01 Sep
NewVision Software
Pune
Senior Big Data Engineer Locations: Pune Experience: 5 - 7 Years Mode of Work: Hybrid About the role: Senior Big Data Engineer IF YOU ARE:5+ years of industrial experience in Big Data Engineering Strong proficiency in SQL and at least one programming language: Python, Scala, or Java Hands-on experience with AWS and Snowflake Strong Experience in Data Build Tool (DBT) Experience with cloud storages: AWS S3, Azure Storage, Google Cloud Storage Practical skills with Hadoop-like environments (EMR, HDInsight, Dataproc)Experience with Big Data frameworks: Apache Spark, Databricks, Apache Flink, Apache Beam Knowledge of orchestration tools: Airflow, Ni Fi, AWS Glue, Azure Data Factory, Cloud Composer Experience with streaming platforms: Kafka, Kinesis, SQS, Event Hub, Pub/Sub, Io T Hub Familiarity with data warehousing and analytics: Snowflake, Redshift, Athena, Synapse Experience working with containerization & serverless technologies (Docker, Lambda, Fargate, Functions, Cloud Run)Understanding of data governance, data quality,
and data lifecycle processes Solid communication and collaboration skills English at Upper?Intermediate level Bachelor’s degree in Computer Science or similar (preferred)AWS or Snowflake certifications (preferred)AND YOU WANT TO: Design and optimize distributed computing architectures for scalable Big Data processing Build and enhance batch and streaming data pipelines Implement advanced data processing: real?time analytics, ML-driven models, predictive insights Develop reusable, parameterized ETL/ELT pipelines for DWH and lakehouse solutions Conduct end?to?end data flow validation and performance optimization Implement best practices for data quality, lineage, and governance Configure and maintain CI/CD flows and release pipelines Work with containerized and multi-container development environments Troubleshoot complex data infrastructure and processing issues Contribute to architectural decisions and technology selection Ensure secure customer data management throughout the entire project lifecycle Follow data retention, deletion, and off-boarding procedures Mentor junior engineers and support technical decision-making
📌 Senior Bigdata Engineer (Pune)
🏢 NewVision Software
📍 Pune