26 Aug
|
Baseel Partners
|
Chennai
26 Aug
Baseel Partners
Chennai
Job Description: Senior Cloud Data Architect (Data Engineering Focus)
Experience Level: 10+ Years
Engagement: Contract / Fractional Lead (1620 Hours/Week)
Primary Tech Stack: Snowflake DLH, dbt, SQL, Python, Pimcore 11 (Integration), Docker/Containerization, CI/CD DevOps, Data Observability & Monitoring
Role Summary
We are seeking a Senior Cloud Data Architect with a strong Data Engineering background to drive the cloud architecture, pipeline engineering, and upstream data quality for our enterprise Data Lakehouse (Snowflake) and its integration with our Master Data Management platform (Pimcore 11).
In this role, you will bridge technical execution with business architecturebuilding scalable Snowflake pipelines, defining robust Data Quality (DQ) framework rules, and partnering closely with our MDM Lead and cross-functional teams to ensure seamless data flows and operational efficiency.
Core Responsibilities
1. Data Lakehouse Architecture & Pipeline Engineering
- Architect, build, and optimize end-to-end data pipelines connecting Snowflake Data Lakehouse layers (RAW, PROCESSED, CURATED) with external applications and MDM systems.
- Oversee data transformation logic, dbt models/snapshots, SCD Type 2 historical tracking, and surrogate key hashing mechanisms.
- Define resilient ingestion patterns for Change Data Capture (CDC), transaction log parsing for hard deletes, and cross-system entity reconciliation.
2. Integration & Upstream Data Modeling
- Partner directly with the MDM Lead to align Snowflake curated layer schemas with Pimcore 11 data classes and target object models.
- Establish explicit source-to-target mapping specifications, data contracts,
and survivorship/golden record staging logic upstream of MDM ingestion.
- Evaluate structural options (flattened vs. relational header/split models) to optimize query performance and API payload delivery.
3. Data Governance, Quality, Observability & Exception Handling
- Design and implement automated Data Quality (DQ) profiling, validation checks, and bad record routing across raw and curated layers.
- Implement data observability metrics (freshness, volume anomalies, schema drift, pipeline SLA tracking) to ensure data reliability.
- Map complete end-to-end data lineage, column-level provenance, and cross-layer reconciliation counts.
4. Technical Leadership, DevOps & Containerization
- Guide environment setups, Docker containerization, and CI/CD deployment pipelines for data assets and integrations.
- Translate business requirements into technical mapping specifications, architecture blueprints, and technical documentation.
- Lead architectural alignment sessions with cross-functional engineering leads (DLH, CRM, ERP) to ensure system compatibility and performance.
Required Qualifications & Technical Skills
- Experience: 10+ years of hands-on experience in Cloud Data Architecture, Data Engineering, and Enterprise Data Warehousing.
- Cloud Data Warehousing: Deep expertise in Snowflake architecture, dbt, query performance tuning, zero-copy cloning, RBAC security, and data sharing.
- ETL, Data Modeling & Languages: Expert-level SQL, Python, dimensional modeling (SCD2, star schemas, surrogate keys, MD5 hashing), and batch/streaming data patterns.
- Integrations & MDM Awareness: Strong experience integrating lakehouses with MDM or enterprise software (Pimcore, Reltio, Informatica, etc.) via REST/GraphQL APIs, webhooks, and event-driven architectures.
- DevOps, Observability & Containerization: Practical experience with Docker/VM containerized environments, CI/CD deployment, and data pipeline monitoring/observability tooling.
- Stakeholder Communication: Excellent technical communication skills, with a proven ability to lead architecture discussions with senior engineering teams and business stakeholders alike.
Compensation:
- Hourly rate of INR 1,250 with working of minimum 16 hours per week leading to INR20,000 per week
- Working from Home
- Immediate start
- You can work part time
Baseel:
Baseel Partners LLP (Baseel.com) is a company initially focused on cybersecurity and data protection. Today, Baseel Group has expanded significantly, providing a comprehensive suite of IT services and products to clients in over 100 countries. A distinguished global entity, Baseel Partners LLP has established a strong network of partners across Europe, the UK, Asia, and MENA countries. Baseel has some clients in the area of Data Governance who are looking for MDM implementation.
📌 Senior Cloud Data Architect Data Engineering Focus (Chennai)
🏢 Baseel Partners
📍 Chennai