16 Aug
|
Stack Digital
|
Hubballi
16 Aug
Stack Digital
Hubballi
Job Overview
We are looking for an experienced Data Engineer with strong expertise in Fabric Pipelines, Data Orchestration, Apache Spark, Scala, and SQL to join the Core Team for the Symphony program supporting The Coca-Cola Company. The ideal candidate will be a hands-on engineer capable of designing, building, optimizing, and maintaining scalable data pipelines in a large enterprise data environment.
Roles Responsibilities
- Migrate Spark Job Definitions from Microsoft Azure Synapse Analytics to Microsoft Microsoft Fabric
- Build and manage Fabric Pipelines and data orchestration workflows
- Design, develop, and maintain scalable data pipelines using Apache Spark, Scala, and SQL
- Monitor and support production pipelines post go-live
- Troubleshoot pipeline failures, data quality issues, and performance bottlenecks
- Refactor and optimize existing code for better performance and scalability
- Develop reusable frameworks, automation patterns, and engineering best practices
- Work within metadata-driven architecture standards
- Ensure orchestration pipelines are used strictly for scheduling while ETL logic remains in code
- Manage source code using GitHub
- Participate in discovery sessions to gather and analyze data requirements
Required Skills / Primary Skills
- Fabric Pipelines
- Data Orchestration
- Apache Spark
- Scala / Java
- SQL
- Azure Synapse Analytics
- GitHub
- Data Warehousing
- Large-scale Data Integration
Basic Qualifications
- 8 10 years of hands-on Data Engineering experience
- Solid understanding of Spark architecture and core concepts
- Proficiency in Scala and/or Java (code-first development)
- Advanced SQL expertise
- Experience with cloud-based data engineering platforms
- Bachelor s degree in Computer Science, IT, or related field (or equivalent experience)
Good to Have
- Experience with Microsoft Fabric
- Experience in Marketing Data / Consumer Goods Analytics
- Knowledge of Metadata-Driven Architectures
Non-Negotiables
- Strong hands-on development experience
- Immediate joiners preferred
- Must be comfortable working in a fast-paced remote environment
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer - (Fabric Pipelines / Orchestration) (Hubballi)
🏢 Stack Digital
📍 Hubballi