08 Nov
|
Flexing It®
|
India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent.
This is an independent consulting role with Our client, a leading wired internet service provider is looking to engage with a Data Architect
Key Responsibilities
- Review and validate the proposed data lake architecture, providing an independent Go / No-Go recommendation.
- Assess the suitability of on-premises, cloud and hybrid deployment models based on workloads, cost, compliance and data residency.
- Evaluate architecture components, including data layering, storage, table formats (Delta, Iceberg, Hudi), compute, query engines and orchestration.
- Review data ingestion frameworks covering batch, streaming and Change Data Capture (CDC).
- Assess data governance practices, including data cataloguing, lineage, data quality, access controls and PII management.
- Evaluate security, encryption, scalability, performance, disaster recovery and system resilience.
- Review migration strategy from existing Hadoop infrastructure, identifying risks,
migration sequencing and rollback plans.
- Identify architectural gaps, recommend necessary modifications and present findings to the architecture team.
Skills Required
- Experience leading at least 2 enterprise-level data lake modernization projects.
- Strong experience in on-premises big data technologies such as Hadoop, Cloudera and Apache Spark.
- Hands-on expertise in cloud data platforms such as AWS, Azure, GCP, Databricks and Snowflake.
- Experience in Hadoop-to-cloud or hybrid migration projects.
- Robust understanding of data lake architecture, storage formats (Delta Lake, Iceberg, Hudi), compute and query engines.
- Expertise in batch and streaming data ingestion, CDC and data orchestration.
- Knowledge of data governance, data security, compliance and disaster recovery.
- Experience in cost optimization, TCO assessment, FinOps and vendor lock-in evaluation.
- Ability to independently challenge architecture decisions and provide objective technical recommendations.
📌 Data Architect (India)
🏢 Flexing It®
📍 India