Data Engineer 1 NOB-833

Data Engineer 1 NOB-833

03 May
Alliance Data
Bangalore Rural

03 May

Alliance Data

Bangalore Rural

It's fun to work in a company where people truly BELIEVE in what they're doing !

Job Summary

The Data Engineer 1 works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. The team also supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need.

Job Description

Essential Job Functions

Collaboration-Collaborateswith internal/external stakeholders to manage datalogistics– including data specifications, transfers, structures, and rules.Collaborateswith business users, business analysts and technical architects in transforming business requirements into analytical workbenches, tools and dashboards reflecting usability best practices and current design trends.Demonstratesanalytical,interpersonalandprofessionalcommunication skills. Learns quickly and works effectively individuallyand as part of a team. 

Process Improvement-Access,extract,andtransform Credit and Retail data from a variety of sources of all sizes (including client marketing databases,2nd and 3rd party data) using Hadoop, Spark, SQL, Big data technologies etc.Providesautomation help to analytical teams around data centric needs using orchestration tools,SQLandpossibly otherbig data/cloud solutions for efficiency improvement.

Project Support-Support Sr. Specialist and Specialist in new analytical proof of concepts and tool exploration projects.Effectively manage time and resourcesin order todeliver on time/correctly on concurrent projects.Involved in creating POCs to ingest and process streaming data using Spark and HDFS.

Data and Analytics-Answer and trouble shoot questions about data sets and analytical tools; Develop,maintainand enhance new and existing analytics tools to support internal customers.Ingest data from files, streams and databasesthenprocess the data with Python andPysparkin order tostore data to Hive or NoSQL database.Manage data coming fromdifferent sourcesand involved in HDFS maintenance and loading of structured and unstructured data.Apply knowledge in AgileScrummethodologythatleveragesthe Client Bigdata platform and used version control tool Git.Importandexportdata using Sqoop from HDFS to RDBMS and vice-versa.Demonstrate anunderstanding of Hadoop Architecture and underlying Hadoop framework including Storage Management.Create POCs to ingest and process streaming data using Spark and HDFS. Work on back-end using Scala, Python and Spark to perform severalaggregationlogics

Technical Skills-Expert in writing complicated SQL Queries and database analysis forgood performance.Experience in working on Microsoft Azure Services like ADLS/Blob Storage solutions, AzureDataFactory, Azure Functions and Databricks.Utilize basic knowledge of RestAPIfor designing networked applications

Reports to: 

Working Conditions/ Physical Requirements: Normal office environment 

Direct Reports: 0

Minimum Qualifications : 

Bachelor’s Degree in Computer Science or Engineering,

0to3years in Data & Analytics

Education Requirements:

Bachelor’s Degree (Required)


Work Experience

None Required


Apache Spark, Azure Blob Storage, Azure Data Factory, Azure Data Lake, Big Data, Cloud Environment, Cloudera Data Platform (CDP), Cloudera Hadoop, Cloudera Impala, Hadoop, HBase, HDFS, Hive, Linux Shell Scripting, NoSQL, Python, RESTful APIs, R Programming, Scala, Structured Query Language (SQL)

The original job offer can be found in Kit Job:

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: data engineer 1 nob-833
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert