30 Oct
|
Yuga Forge Tech
|
India
30 Oct
Yuga Forge Tech
India
About the role:
We’re looking for a Data Engineer to build and maintain reliable data pipelines, integrate data from multiple systems, and develop datasets that support analytics, reporting, and business applications.
You’ll work closely with software engineers, analysts, and business stakeholders to understand data requirements and deliver solutions that are accurate, scalable, and maintainable.
Key responsibilities
- Design, develop, and maintain ETL/ELT pipelines across databases, APIs, files, and external systems.
- Build and manage data models, transformation workflows, and datasets for downstream applications.
- Implement data validation, quality checks, monitoring, and error handling.
- Optimize SQL queries, pipeline performance, and storage costs.
- Investigate data discrepancies, troubleshoot failures, and maintain reliable processing.
- Follow security and access-control requirements when handling data.
- Document data sources, schemas, transformations, and operational procedures.
Required skills
- Robust SQL skills, including joins,
window functions, and query optimization.
- Proficiency in Python for data extraction, transformation, and automation.
- Practical experience building and supporting production data pipelines.
- Working knowledge of relational databases, data warehousing, and dimensional modelling.
- Experience integrating REST APIs and processing structured and semi-structured data, including JSON and CSV.
- Familiarity with Git, testing, logging, and deployment workflows.
- Strong problem-solving skills and the ability to communicate technical concepts clearly.
Good to have
- Experience with AWS, Azure, or Google Cloud.
- Exposure to platforms such as Snowflake, BigQuery, Redshift, or Databricks.
- Familiarity with Airflow, dbt, Spark, or equivalent tools.
- Experience with streaming data, Kafka, or change data capture.
- Exposure to IoT, telemetry, or enterprise system integrations.
📌 Data Engineer (India)
🏢 Yuga Forge Tech
📍 India