31 Aug
|
NewVision Software
|
Mumbai
31 Aug
NewVision Software
Mumbai
Job DescriptionSenior BigData Engineer N? Locations: Pune N? Experience: 5 - 7 Years N? Mode of Work: Hybrid NnAbout the role: NSenior BigData Engineer NnIF YOU ARE: Nn 5+ years of industrial experience in Big Data Engineering N Strong proficiency in SQL and at least one programming language: Python, Scala, or Java N Hands-on experience with AWS and Snowflake N Solid Experience in Data Build Tool (DBT) N Experience with cloud storages: AWS S3, Azure Storage, Google Cloud Storage N Practical skills with Hadoop-like environments (EMR, HDInsight, Dataproc) N Experience with Big Data frameworks: Apache Spark, Databricks, Apache Flink, Apache Beam N Knowledge of orchestration tools: Airflow, NiFi, AWS Glue, Azure Data Factory, Cloud Composer N Experience with streaming platforms: Kafka, Kinesis, SQS, Event Hub, Pub/Sub, IoT Hub N Familiarity with data warehousing and analytics: Snowflake, Redshift, Athena, Synapse N Experience working withcontainerization & serverless technologies (Docker, Lambda, Fargate, Functions, Cloud Run) N Understanding of data governance, data quality,
and data lifecycle processes N Strong communication and collaboration skills N English at Upper?Intermediate level N Bachelor’s degree in Computer Science or similar (preferred) N AWS or Snowflake certifications (preferred) NnnAND YOU WANT TO: Nn Design and optimize distributed computing architectures for scalable Big Data processing N Build and enhance batchand streaming data pipelines N Implement advanced dataprocessing: real?time analytics, ML-driven models, predictive insights N Develop reusable, parameterized ETL/ELT pipelines for DWH and lakehouse solutions N Conduct end?to?end dataflow validation and performance optimization N Implement best practices for data quality, lineage, and governance N Configure and maintain CI/CD flows and release pipelines N Work with containerizedand multi-container development environments N Troubleshoot complex data infrastructure and processing issues N Contribute to architectural decisions and technology selection N Ensure secure customer data management throughout the entire project lifecycle N Follow data retention, deletion, and off-boarding procedures N Mentor junior engineersand support technical decision-making Nn
📌 Senior Bigdata Engineer (Mumbai)
🏢 NewVision Software
📍 Mumbai