04 Aug
|
Golden Hues Consultants Private
|
Mumbai
04 Aug
Golden Hues Consultants Private
Mumbai
8 Years in Data Engineering Architecture Proven experience delivering productiongrade Lakehouse environments for highconcurrency 1 000 user organizations Up-to-date Data Stack Fluency Extensive experience with Databricks Lakehouse Unity Catalog and highperformance warehouses like Amazon Redshift or Snowflake OpenTable Formats Deep handson expertise with Apache Iceberg or Delta Lake including optimization strategies for partitioning and schema evolution Transformation Modeling Mastery of dbt Core for complex SQLbased modeling and PySpark or Python for sophisticated data processing HighEfficiency Compute Familiarity with vectorized embedded engines like DuckDB for specialized or costsensitive processing tasks Orchestration Mastery Advanced experience with Apache Airflow specifically in designing resilient dependencyaware DAGs in resourceconstrained environments Cloud Ecosystems Expertlevel knowledge of AWS S3 EC2 IAM or equivalent services in Azure GCP with a focus on storagecompute separation Experience with opensource catalog implementations like Apache Polaris Knowledge of Data Ops principles and automated data quality testing frameworks Experience translating technical debt and architectural roadmaps for Clevel executives Background in managing fixedresource infrastructure e g EC2 VMbased processing vs elastic serverless models Kubernetes K8s Deep understanding of Pods Deployments Services
📌 Data Platform Architect (Mumbai)
🏢 Golden Hues Consultants Private
📍 Mumbai