02 Oct
|
AGAM Technologies Solutions Private
|
Gandhinagar
02 Oct
AGAM Technologies Solutions Private
Gandhinagar
Job Description
Job Description
n
nExperience: 6+ Years
nRole: Senior Data Engineer
nLocation: Coimbatore- Work from Office
nEmployment Type: Full-time
nAvailability: Immediate Joiner Preferred
n
nRole Summary
n
nWe are seeking an experienced Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data pipelines and data warehouse solutions. The ideal candidate should have solid expertise in ETL/ELT, Python, dbt, Snowflake, workflow orchestration, job scheduling, and Git.
n
nKey Responsibilities
n
n* Design, develop, test, and maintain scalable ETL/ELT data pipelines.
n* Build and manage enterprise data warehouse solutions using Snowflake.
n* Develop reusable data transformation models using dbt.
n* Write efficient and maintainable Python programs for data ingestion, transformation, validation, and automation.
n* Extract and integrate data from databases, APIs, flat files, and other structured or semi-structured sources.
n* Develop dimensional data models using concepts such as:
n * Star and snowflake schemas
n * Fact and dimension tables
n * Slowly Changing Dimensions
n * Surrogate keys
n * Incremental and historical data loads
n* Create and maintain ETL jobs, schedules, dependencies, alerts, and recovery procedures.
n* Work with orchestration and scheduling tools such as Apache Airflow, Control-M, Azure Data Factory, AWS Glue, or similar platforms.
n* Implement data-quality checks, reconciliation processes, audit controls, and exception handling.
n* Monitor pipeline performance and troubleshoot failed or delayed data-processing jobs.
n* Optimize Snowflake queries, storage, warehouses, and overall pipeline performance.
n* Use Git for source-code management, branching, merging, pull requests, code reviews, and release management.
n* Support CI/CD processes for deploying data pipelines and dbt models across environments.
n* Collaborate with business analysts, data analysts, reporting teams, ar
📌 Senior Data Engineer (Gandhinagar)
🏢 AGAM Technologies Solutions Private
📍 Gandhinagar