02 Oct
|
AGAM Technologies Solutions Private
|
Kadapa
02 Oct
AGAM Technologies Solutions Private
Kadapa
Job Description
Experience: 6+ Years
Role: Senior Data Engineer
Location: Coimbatore- Work from Office
Employment Type: Full-time
Availability: Immediate Joiner Preferred
Role Summary
We are seeking an experienced Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data pipelines and data warehouse solutions. The ideal candidate should have strong expertise in ETL/ELT, Python, dbt, Snowflake, workflow orchestration, job scheduling, and Git.
Key Responsibilities
* Design, develop, test, and maintain scalable ETL/ELT data pipelines.
* Build and manage enterprise data warehouse solutions using Snowflake.
* Develop reusable data transformation models using dbt.
* Write productive and maintainable Python programs for data ingestion, transformation, validation, and automation.
* Extract and integrate data from databases, APIs, flat files, and other structured or semi-structured sources.
* Develop dimensional data models using concepts such as:
* Star and snowflake schemas
* Fact and dimension tables
* Slowly Changing Dimensions
* Surrogate keys
* Incremental and historical data loads
* Create and maintain ETL jobs, schedules, dependencies, alerts, and recovery procedures.
* Work with orchestration and scheduling tools such as Apache Airflow, Control-M, Azure Data Factory, AWS Glue, or similar platforms.
* Implement data-quality checks, reconciliation processes, audit controls, and exception handling.
* Monitor pipeline performance and troubleshoot failed or delayed data-processing jobs.
* Optimize Snowflake queries, storage, warehouses, and overall pipeline performance.
* Use Git for source-code management, branching, merging, pull requests, code reviews, and release management.
* Support CI/CD processes for deploying data pipelines and dbt models across environments.
* Collaborate with business analysts, data analysts, reporting teams, architects, and other stakeholders to understand data requirements.
* Prepare and maintain t
📌 Senior Data Engineer (Kadapa)
🏢 AGAM Technologies Solutions Private
📍 Kadapa