Principal Engineer for the Advanced BigData Analytics Service - (RR-030)

Principal Engineer for the Advanced BigData Analytics Service - (RR-030)

14 Sep
Bangalore Rural

14 Sep


Bangalore Rural

Preferred Qualifications

Oracle Cloud Infrastructure (OCI) is leadingthe transformation to cloud-native Big Data technologies in our hyperscale,multi-tenant cloud deployed in more than 20 regions worldwide. OCI is committedto providing the best in cloud services that meet the needs of our customerswho are tackling some of the world's biggest challenges. We offer uniqueopportunities for smart, hands-on engineers with the expertise and passion tosolve difficult problems in distributed highly available services andvirtualized infrastructure.

We’re looking for a senior engineer withexpertise and passion in solving difficult problems in distributed systems andhighly available services, who can help in the buildout,

and subsequentlyfurther development, of an advanced Data Analytics Service, based on ApacheSpark and cubing technologies. At OCI, you can help, shape, design and buildinnovative new systems from the ground up. These are exciting times in ourspace - we are growing fast, still at an early stage, and working on ambitiousnew initiatives. Senior engineers at any level can have significant technicaland business impact.

From a technology perspective, this is a greenfielddevelopment environment with a huge amount of autonomy, leaving us free tobuild and innovate without being encumbered by legacy products and services.Our, the Advanced BigData Analytics Service, team’scharter is to build a fully managed, cloud native service focused on largescale analytics on (mostly) unstructured data stored in data lakes, and managementof the data in the data lakes. The service is based on Apache Spark,Kubernetes, and a number of OLAP extensions on top. The service work scopeencompasses not just good integration with OCI’s native infrastructure(security, cloud storage, etc.), but also deep integration with other relevantcloud native services in OCI (like Data Catalog). It includes doing cloudnative ways of doing service level patching & upgrades, and maintaininghigh availability of the service in the face of random failures & planneddowntimes in the underlying infrastructure (e.g., for things like patching thelinux kernels to take care of a security vulnerability). Developing systems formonitoring and getting telemetry into the service’s runtime characteristics andbeing able to take actions on the telemetry data is a part of the charter. Theplatform work involves deep technical deep dives into the various areas - queryplanning and optimization, query execution, etc., and making the SQL enginereally work well in the cloud, and be able to use the cloud’s “infinite”resources and yet be cost effective.


●Work with members of the team andparticipate in the design and development of key features needed to make theData Analytics Service successful

●Support a highly available andresilient cloud service, and build the supporting systems in/outside ApacheSpark to be able to deliver on these

●Contribute to the Apache Sparkcommunity as necessary

●Lead feature development work bothwithin OCI and champion the work as necessary in the Apache Spark community andother communities as needed

●Work with the team and outside toget necessary approvals for the architecture and design for the problem at hand

●Experiment with the compute /storage / networking infrastructure as necessary and be able to recommendimprovements in the way the service runs in various dimensions of performance,reliability, optimal cost, etc. (cloud native SQL query optimizations)

●Be on top of what’s happening inthe Apache Spark and other related communities, and participate in communitydiscussions, events, conferences, etc.

DesiredSkills and Experience

●8+ years of experience in softwaredevelopment.

●Strong knowledge of datastructures, algorithms, & distributed systems.

●Proficiency in Spark development.

●Experience building Services usingSpark.

●Strong programming skills in Java

●Development experience using Cloudnative infrastructures like Kubernetes

●Experience working with Databasesystems and internals

●Experience with SQL and datamanagement

●Take initiative and be responsiblefor delivering complex software

●Excellent problem solver,analytical thinker and quick learner

●BS or MS in Computer Science or arelated technical field

●Design, develop, troubleshoot anddebug software programs for databases, applications, tools, networks etc.

The original job offer can be found in Kit Job:

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: principal engineer for the advanced bigdata analytics service - (rr-030)
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert