12 Oct
|
Recruise India Consulting
|
India
12 Oct
Recruise India Consulting
India
ob Description: Data Engineer – Medallion Architecture & Integrations
Contract Duration: 12 Months
Work Mode: Remote
Time Zone: Eastern Standard Time (EST)
Engagement Type: Contract
Job Summary
We are looking for an experienced Data Engineer with robust expertise in Medallion Architecture, Databricks, dbt, Python, and Epicor integration. The ideal candidate will be responsible for building and maintaining scalable data pipelines, integrating enterprise data sources, and developing reliable data transformation workflows to support analytics and business reporting.
Key Responsibilities
- Design, develop, and maintain data pipelines using Databricks and Python .
- Implement and manage Medallion Architecture (Bronze, Silver, and Gold layers) for structured data ingestion, transformation, and processing.
- Develop, test, and optimize data transformation models using dbt .
- Build and maintain integrations between Epicor ERP and data platforms , ensuring accurate and reliable data exchange.
- Develop ETL/ELT workflows to ingest, cleanse, transform, and validate data from multiple sources.
- Optimize data processing performance, pipeline reliability, and data quality.
- Collaborate with business stakeholders and technical teams to understand data requirements and deliver scalable solutions.
- Implement data validation, monitoring, error handling, and troubleshooting processes.
- Maintain technical documentation for data pipelines, integrations, and transformation models.
Required Skills
- Strong hands-on experience with Databricks and data engineering.
- Practical experience implementing Medallion Architecture .
- Proficiency in Python for data processing and pipeline development.
- Experience with dbt for data transformation, testing, and model management.
- Experience integrating Epicor ERP with data warehouses, lakehouses, or downstream applications.
- Strong understanding of ETL/ELT concepts, data modelling, SQL, and data quality.
- Experience building and troubleshooting production-grade data pipelines.
Work Requirements
- Must be available to work remotely while aligning with the US Eastern Time Zone (EST/EDT) .
- Ability to work independently and collaborate with distributed teams.
- Comfortable working in a 12-month contract engagement.
Preferred Qualifications
- Experience with cloud-based data platforms and lakehouse architectures.
- Familiarity with orchestration tools, version control, and CI/CD practices.
- Experience with Epicor APIs, connectors, or other ERP integration mechanisms.
- Understanding of data governance, security, and access controls.
Contract Duration: 12 months | Location: Remote | Time Zone Alignment: US Eastern Time
📌 Data Engineer – Databricks, dbt & Epicor Integration (Contract) (India)
🏢 Recruise India Consulting
📍 India