Description

Job Responsibilities:

Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python

Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake

Build and automate data workflows using Apache Airflow

Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)

Implement data quality checks, validation, and monitoring for production pipelines

Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems

Maintain code quality through Git version control, code reviews, and documentation

Develop shell scripts to automate operational and deployment tasks

Containerize applications and data services using Docker

Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives

Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality

Document technical designs, workflows, and project progress using Jira and Confluence

Job Description:





Bachelor’s degree in Computer Science, Information Technology, or a related field with 5+ years of experience in Data Engineering or ETL Development

Strong knowledge of SQL and relational database concepts

Experience working with Microsoft SQL Server, PostgreSQL, and Snowflake

Robust programming skills in Python with experience using NumPy and Pandas

Basic knowledge of PySpark for distributed data processing

Experience building ETL/ELT pipelines using SSIS and DBT

Experience scheduling and orchestrating workflows using Apache Airflow

Hands-on experience with AWS services including:-

Amazon S3
AWS Lambda
Amazon EC2
Amazon RDS
AWS IAM

Strong understanding of database concepts including:-

Normalization and Denormalization

OLTP vs OLAP
Data Warehousing
Data Modeling
Performance Tuning

Experience with Git version control and collaborative development workflows

Knowledge of Docker and co

📌 Data Engineer7 (Chennai)
🏢 GlobalLogic
📍 Chennai