10 Aug
|
Dassault Systèmes
|
India
10 Aug
Dassault Systèmes
India
Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering as a Big Data Developer in Pune, India
Role Description & Responsibilities:
Data Pipeline Development: Design, develop, and maintain robust ETL pipelines for batch and real-time data ingestion, processing, and transformation using Spark, Kafka, and Python.
Data Architecture: Build and optimize scalable data architectures, including data lakes, data marts, and data warehouses, to support business intelligence, reporting, and machine learning.
Data Governance: Ensure data reliability, integrity, and governance by enabling accurate, consistent, and trustworthy data for decision-making.
Collaboration: Work closely with data analysts, data scientists, and business stakeholders to gather requirements, identify inefficiencies, and deliver scalable and impactful data solutions.
Optimization: Develop productive workflows to handle large-scale datasets, improving performance and minimizing downtime.
Documentation: Create detailed documentation for data processes, pipelines,
and architecture to support seamless collaboration and knowledge sharing.
Innovation: Contribute to a thriving data engineering culture by introducing new tools, frameworks, and best practices to improve data processes across the organization.
Qualifications:
Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field.
Professional Experience: 2–5 years of experience in data engineering, with expertise in designing and managing complex ETL pipelines.
Technical Skills:
Proficiency in Python, PySpark, and Spark SQL for distributed and real-time data processing.
Deep understanding of real-time streaming systems using Kafka.
Experience with data lake and data warehousing technologies (Hadoop, HDFS, Hive, Iceberg, Apache Spark).
Strong knowledge of relational and non-relational databases (SQL, NoSQL).
Experience in cloud and on-premises environments for building and managing d
📌 Big Data Developer (India)
🏢 Dassault Systèmes
📍 India