It's fun to work in a company where people truly BELIEVE in what they're doing !
The Data Engineer 1 works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. The team also supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need.
Essential Job Functions
Collaboration-Collaborateswith internal/external stakeholders to manage datalogistics– including data specifications, transfers, structures, and rules.Collaborateswith business users, business analysts and technical architects in transforming business requirements into analytical workbenches, tools and dashboards reflecting usability best practices and current design trends.Demonstratesanalytical,interpersonalandprofessionalcommunication skills. Learns quickly and works effectively individuallyand as part of a team.
Process Improvement-Access,extract,andtransform Credit and Retail data from a variety of sources of all sizes (including client marketing databases,2nd and 3rd party data) using Hadoop, Spark, SQL, Big data technologies etc.Providesautomation help to analytical teams around data centric needs using orchestration tools,SQLandpossibly otherbig data/cloud solutions for efficiency improvement.
Project Support-Support Sr. Specialist and Specialist in new analytical proof of concepts and tool exploration projects.Effectively manage time and resourcesin order todeliver on time/correctly on concurrent projects.Involved in creating POCs to ingest and process streaming data using Spark and HDFS.
Data and Analytics-Answer and trouble shoot questions about data sets and analytical tools; Develop,maintainand enhance new and existing analytics tools to support internal customers.Ingest data from files, streams and databasesthenprocess the data with Python andPysparkin order tostore data to Hive or NoSQL database.Manage data coming fromdifferent sourcesand involved in HDFS maintenance and loading of structured and unstructured data.Apply knowledge in AgileScrummethodologythatleveragesthe Client Bigdata platform and used version control tool Git.￼￼Importandexportdata using Sqoop from HDFS to RDBMS and vice-versa.Demonstrate anunderstanding of Hadoop Architecture and underlying Hadoop framework including Storage Management.Create POCs to ingest and process streaming data using Spark and HDFS. Work on back-end using Scala, Python and Spark to perform severalaggregationlogics
Technical Skills-Expert in writing complicated SQL Queries and database analysis forgood performance.Experience in working on Microsoft Azure Services like ADLS/Blob Storage solutions, AzureDataFactory, Azure Functions and Databricks.Utilize basic knowledge of RestAPIfor designing networked applications
Working Conditions/ Physical Requirements: Normal office environment
Direct Reports: 0
Minimum Qualifications :
Bachelor’s Degree in Computer Science or Engineering,
0to3years in Data & Analytics
Bachelor’s Degree (Required)
Apache Spark, Azure Blob Storage, Azure Data Factory, Azure Data Lake, Big Data, Cloud Environment, Cloudera Data Platform (CDP), Cloudera Hadoop, Cloudera Impala, Hadoop, HBase, HDFS, Hive, Linux Shell Scripting, NoSQL, Python, RESTful APIs, R Programming, Scala, Structured Query Language (SQL)
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.
About VIAVI Solutions VIAVI (NASDAQ: VIAV) has a 90+ year history of technical innovations that have evolved to keep pace and address our customer’s most pressing business issues. We make equipmen [...]
Are you ready for the next step in your career? Then you need to keep reading! When we’re looking to hire at Amadeus, we look internally first. Our teams get the benefit of your experience and you g [...]
About Print Analytics As part of the HP Inc. R&D; Hub, Print Analytics Team work closely with Print GBU of HP Inc. across multiple domains. We provide data-driven actionable insights to influence bu [...]
SCAM ALERT: Caution against fraudulent job offers! More Info × SCAM ALERT Caution against fraudulent job offers! We have been informed of instances where jobseekers are led to belie [...]