We are seeking a skilled and motivated
Data Engineer
with strong expertise in
Python, Snowflake, Azure Data Factory (ADF), and Linux
. The ideal candidate will be responsible for developing, optimizing, and maintaining data pipelines, ETL workflows, and cloud-based data platforms to support business applications.
Key Responsibilities:
- Develop and maintain robust data pipelines using Python and ADF.
- Design and optimize ELT/ETL processes to load data into Snowflake from various sources.
- Implement performance tuning and monitoring on Snowflake queries and tables.
- Collaborate with data architects and analysts to understand data requirements and provide scalable solutions.
- Automate recurring data ingestion and transformation tasks using scripting in Linux environments.
- Manage data security, access controls, and data quality standards in Snowflake.
- Schedule and monitor ADF pipelines for production loads and troubleshooting failures.
- Integrate external APIs or databases as needed for data enrichment and ingestion.
- Perform root cause analysis and provide timely resolutions to data issues.
Required Qualifications:
- 5+ years of experience in data engineering or backend data development.
- Robust proficiency in Python for scripting, data manipulation, and API interaction.
- Hands-on experience with Snowflake including schema design, SQL development, and performance tuning.
- Practical experience with Azure Data Factory: pipelines, triggers, datasets, and linked services.
- Proficiency with Linux/Unix command line, shell scripting, and cron jobs.
- Experience working with large-scale datasets and cloud data platforms.
- Strong understanding of data modeling concepts (star/snowflake schema).
- Familiarity with version control systems such as GitLab.
Preferred Qualifications:
- Experience with Azure services.
- Knowledge of CI/CD pipelines in a data engineering context.
Background in data warehousing or big data solutions.
📌 Data Engineer (India)
🏢 GTECH
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.