DESCRIPTION GPP Database Link https cummins365 sharepoint com sites CS38534 Job Summary Leads projects for design development and maintenance of a data and analytics platform Effectively and efficiently process store and make data available to analysts and other consumers Works with key business stakeholders IT experts and subject-matter experts to plan design and deliver optimal analytics and data science solutions Works on one or many product teams at a time Key Responsibilities Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources relational event-based unstructured Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues Implements data governance processes and methods for managing metadata access retention to data for internal and external users Designs and provide guidance on building reliable efficient scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL ELT tools or scripting languages Designs and implements physical data models to define the database structure Optimizing database performance through productive indexing and table relationships Participates in optimizing testing and troubleshooting of data pipelines Designs develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data e g Data Lakes Hadoop Hbase Cassandra MongoDB Accumulo DynamoDB others Uses innovative and modern tools techniques and architectures to partially or completely automate the most-common repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity Assists with renovating the data management infrastructure to drive automation in data integration and management Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps Scrum Kanban Coaches and develops less experienced team members RESPONSIBILITIES Competencies System Requirements Engineering - Uses appropriate methods and tools to translate stakeholder needs into verifiable requirements to which designs are developed establishes acceptance criteria for the system of interest through analysis allocation and negotiation tracks the status of requirements throughout the system lifecycle assesses the impact of changes to system requirements on project scope schedule and resources creates and maintains information linkages to related artifacts Collaborates - Building partnerships and working collaboratively with others to meet shared objectives Communicates effectively - Developing and delivering multi-mode communications that convey a clear understanding of the unique needs of different audiences Customer focus - Building strong customer relationships and delivering customer-centric solutions Decision quality - Making good and timely decisions that keep the organization moving forward Data Extraction - Performs data extract-transform-load ETL activities from variety of sources and transforms them for consumption by various downstream applications and users using appropriate tools and technologies Programming - Creates writes and tests computer code test scripts and build scripts using algorithmic analysis and design industry standards and tools version control and build and test automation to meet business technical security governance and compliance requirements Quality Assurance Metrics - Applies the science of measurement to assess whether a solution meets its intended outcomes using the IT Operating Model ITOM including the SDLC standards tools metrics and key performance indicators to deliver a quality product Solution Documentation - Documents information and solution based on knowledge gained as part of product development activities communicates to stakeholders with the goal of enabling improved productivity and effective knowledge transfer to others who were not originally part of the initial learning Solution Validation Testing - Validates a configuration item change or solution using the Function s defined best practices including the Systems Development Life Cycle SDLC standards tools and metrics to ensure that it works as designed and meets customer requirements Data Quality - Identifies understands and corrects flaws in data that supports effective information governance across operational business processes and decision making Problem Solving - Solves problems and may mentor others on effective problem solving by using a systematic analysis process by leveraging industry standard methodologies to create problem traceability and protect the customer determines the assignable cause implements robust data-based solutions identifies the systemic root causes and ensures actions to prevent problem reoccurrence are implemented Values differences - Recognizing the value that different perspectives and cultures bring to an organization Education Licenses Certifications College university or equivalent degree in relevant technical discipline or relevant equivalent experience required This position may require licensing for compliance with export controls or sanctions regulations Experience Intermediate experience in a relevant discipline area is required Knowledge of the latest technologies and trends in data engineering are highly preferred and includes 5-8 years of experince Familiarity analyzing complex business systems industry requirements and or data regulations Background in processing and managing large data sets Design and development for a Big Data platform using open source and third-party tools SPARK Scala Java Map-Reduce Hive Hbase and Kafka or equivalent college coursework SQL query language Clustered compute cloud-based implementation experience Experience developing applications requiring large file movement for a Cloud-based environment and other data extraction tools and methods from a variety of sources Experience in building analytical solutions Intermediate experiences in the following are preferred Experience with IoT technology Experience in Agile software development QUALIFICATIONS 1 Work closely with business Product Owner to understand product vision 2 Play a key role across DBU Data Analytics Power Cells to define develop data pipelines for efficient data transport into Cummins Digital Core Azure DataLake Snowflake 3 Collaborate closely with AAI Digital Core and AAI Solutions Architecture to ensure alignment of DBU project data pipeline design standards 4 Independently design develop test implement complex data pipelines from transactional systems ERP CRM to Datawarehouses DataLake 5 Responsible for creation maintenence and management of DBU Data Analytics data engineering documentation and standard operating procedures SOP 6 Take part in evaluation of new data tools POCs and provide suggestions 7 Take full ownership of the developed data pipelines providing ongoing support for enhancements and performance optimization 8 Proactively address and resolve issues that compromise data accuracy and usability Preferred Skills Programming Languages Proficiency in languages such as Python Java and or Scala Database Management Expertise in SQL and NoSQL databases Big Data Technologies Experience with Hadoop Spark Kafka and other big data frameworks Cloud Services Experience with Azure Databricks and AWS cloud platforms ETL Processes Strong understanding of Extract Transform Load ETL processes Data Replication Working knowledge of replication technologies like Qlik Replicate is a plus API Working knowledge of API to consume data from ERP CRM Job Systems Information Technology Organization Cummins Inc Role Category Remote Job Type Exempt - Experienced ReqID 2417810 Relocation Package Yes

📌 Data Engineer - Senior (Maharashtra)
🏢 Cummins
📍 Maharashtra