About the Role
As our Data Architect, you’ll define the end-to-end architecture for a contemporary, hybrid on-premises and AWS cloud data platform. You’ll standardize our data lake/lakehouse patterns, choose the right compute engines, table formats, and catalogs, and partner with security, platform, analytics, and app teams to deliver governed, performant data products at scale.

What You’ll Do
Own the reference architecture for our data platform across on-prem (e.g., Hadoop/Cloudera, Spark on K8s, SQL Server/Oracle) and AWS (S3, Glue/EMR, Lake Formation, Redshift, ECS/EKS).
Design lakehouse patterns using Apache Iceberg (and/or Delta Lake/Hudi) with the right catalog (e.g., AWS Glue, Hive Metastore, Polaris/REST catalogs) and optimize for ACID, time travel, schema evolution, and multi-engine reads.
Select and integrate compute engines: Apache Spark (Databricks/EMR), Trino/Starburst, Dremio, Snowflake, and pushdown-aware query acceleration.
Model data (conceptual/logical/physical) and define domain-driven data products, semantic layers, and dimensional/ELT designs.




Establish governance: data cataloging, lineage, PII classification, Lake Formation permissions, IAM roles, row/column-level security, and auditing.
Drive performance & cost: partitioning, Z-order/cluster, predicate pushdown, file sizes/compaction, caching, and workload isolation.
Lead migration roadmaps from on-prem EDW/DW to lakehouse (e.g., Informatica/SSIS/SAP BW → Spark/dbt/ELT), including dual-run cutovers and data validation.
Partner with Data Engineering to standardize pipeline frameworks (Airflow/Glue Workflows/dbt/Kedro), CI/CD, and reliability (SLAs, SLOs, observability, quality rules).
Guide streaming (Kafka/Kinesis/MSK, Spark Structured Streaming) and batch patterns; define CDC approaches (Debezium, DMS, Fivetran).
Create architecture docs and guardrails (naming, zones, schemas, S3 layout, encryption, backup/DR, multi-region).
Mentor engineers and review designs for scalability, security, and operab

📌 Data Architect (India)
🏢 Pashtek • Salesforce Partner | Data & AI
📍 India