JOB DESCRIPTION (JD)

Job Title

Specialist

Date

24-09-2024

Function

Information Technology

JD written by

Vinod R Iyer

Reporting To

Vinod R Iyer

JD Approved by

Human Resources

Brand

Multiple

Work Location

Hyderabad

About GUS India

- GUS Education India (GEI) is the education arm of Global University Systems, a leading Global Education conglomerate. Established in 2017, GEI boasts a portfolio of over 35 Institutions and collaborates with prestigious universities and institutions worldwide, offering educational services that enhance their operations and impact.

Nature of the Job

- AWS Data Engineer role is highly technical, focusing on building, maintaining, and optimizing data pipelines and infrastructure within the AWS cloud environment.
- it involves leveraging AWS technologies to ensure smooth data processing and infrastructure management, requiring problem-solving and analytical skills, as well as collaboration across teams.

JOB PURPOSE

- What Is The Opportunity?

Data Engineers work as part of the Data Platform Team, collaborating closely with data scientists, software engineers, and analysts across the company. They assist in building and maintaining the tooling and infrastructure that support decision-making processes and enable product enhancements by ensuring a reliable and unified view of business data. Under the guidance of senior team members, they help prioritize tasks to ensure key features are developed in the proper sequence. They also contribute to the balance between supporting the immediate needs of strategic teams and Data Analysts while participating in the ongoing development of the company's data infrastructure.
- Our Technology Stack

Our tech stack consists of a core ETL process written in Python and SQL, which is being managed by AWS Services like Redshift, Athena, Step Functions, CloudFormation (Infrastructure as Code - IaC) having provided data from multiple sources like salesforce, application logs, and other operational data sources. We use version control as GIT and CI/CD pipelines with AWS Code commit, Code pipeline and code build.

PRINCIPAL RESPONSIBILITIES

RESPONSIBILITIES

ACTIONS

Data Engineer

This Data Engineer supports our Senior Data Engineers and will be responsible for utilizing expertise and knowledge of AWS services to transform raw data and ingest it into data warehouses and data lakes. You will work closely with the development team and would be responsible for providing quality code.

Reading data from multiple sources,



transform and ingest data into Redshift using Python and SQL Working with different business units to understand requirements and collaborating with them to deliver data pipelines Design, develop, and execute data analysis plans using AWS services like Amazon Redshift and Amazon Athena Maintaining and creating new data pipelines using AWS Step functions Build and maintain infrastructure as code (IaC) in the cloud that is resilient and can scale when needed.

Above all, we are looking for people who are curious, think critically, are eager to learn and keen to use their experience to help and support others. You will need to be able to communicate and explain things clearly and work well in a collaborative environment as well as autonomously.

KRA’s

KPI’s

Data Pipeline Development and Maintenance

- Design, build, and maintain efficient data pipelines using AWS services such as AWS Glue, Lambda, and Step Functions.
- Ensure scalability, reliability, and efficiency of pipelines to support large datasets.

Data Pipeline Reliability
- % of successful data pipeline executions vs. failures.
- Uptime percentage for critical data pipelines.

Data Processing Time
- Average time taken to process data from ingestion to loading into the final storage.
- Latency for real-time data pipelines.

Automation Coverage
- % of data engineering tasks that are automated (e.g., pipeline monitoring, scaling).
- Reduction in manual intervention for routine tasks.

ETL/ELT Processes
- Implement Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) processes using AWS Glue, Athena, or Redshift.

Data Availability

- Time taken to make new data available for consumption (batch processing time, real-time data latency).
- Frequency of data availability to business users.

Automation and Optimization
- Automate routine data engineering tasks, such as data pipeline monitoring and alerting.
- Optimize resource utilization to reduce costs on AWS infrastructure.

Data Security Compliance

- % compliance with data security standards (e.g., encryption, access policies).
- Number of security incidents or breaches related to data pipelines.

Monitoring and Troubleshooting

- Ensure monitoring, logging, and debugging of data pipelines using AWS CloudWatch, AWS X-Ray, or third-party tools.




- Manage incidents and outages, ensuring quick recovery.

Stakeholder Satisfaction
- Feedback from business users, analysts, and other stakeholders on data delivery and quality.
- Turnaround time for addressing data-related issues or requests.

The Key Result Areas (KRAs) and Key Performance Indicators (KPIs)should be assessed biannually to ensure that the person carrying out the job is consistent performance aligned with Potential challenges in measuring performance due to complexities in organizational processes that hinder target achievement need to be considered.

DESIRED PROFILE

QUALIFICATION

- Bachelor's degree in a related field
- At least 3 years of experience in a similar role.
- Experience in higher education or a related domain is preferred

SKILLS

- Solid interpersonal and communication skills
- Ability to work independently and as part of a team
- Strong problem-solving and decision-making skills
- Proficient in Product/Project life cycle management tools like JIRA
- Ability to multitask and meet the work deadlines

RELEVANT EXPERIENCE

4+ years of relevant experience

OTHER

- This role is a full-time position with competitive salary and benefits package.

- There is an expectation that employee will maintain the values of the Group and will comply with the code of conduct as well as equality and diversity, health and safety and safeguarding policies.

BENEFITS

- At GUS Education India, GEI we want employees to feel comfortable, bringing their passion, creativity, and individuality to work. We truly believe that diverse culture, backgrounds, and experiences drive innovation.

- The company offers comprehensive medical insurance to its employees, which include hospitalization, accidental insurance, term insurance and Gratuity, which is over and above the compensation. Considering that this role is for night shift, we provide additional competitive night shift allowance for all days worked.

- To make the daily commute easier, safe, and less stressful, company provides cab facilities to its employees to and from the workplace within the Greater Hyderabad Municipal Corporation limits.

- Company acknowledges the importance of mental and physical well-being and the need for rest and relaxation. Work days are Monday to Friday and a comprehensive leave package for employee well-being is offered, which include 10 days of medical leave, 6 days of casual leave, 18 days of earned leave, 1 day of Happiness Leave, apart from 10 days of statutory leave, totalling to 45 days’ time off in a year.

📌 Specialist - Business Intelligence (Hyderabad)
🏢 GEI
📍 Hyderabad