24 Sep
|
HCL INDIA
|
Bengaluru
24 Sep
HCL INDIA
Bengaluru
We are looking for an experienced Data Architect specializing in Data Lakes, BI, Databricks, and Big Query designs and governs scalable cloud data platforms, builds robust ETL/ELT pipelines, defines enterprise data models, and enforces governance using tools like Delta Lake, Unity Catalog, and Big Query while enabling analytics and BI solutions such as Power BI, Tableau, and Looker.
Key Responsibilities
- Architect end-to-end data platforms including data lakes, warehouses, and lake houses.
- Define conceptual, logical, and physical data models and canonical definitions.
- Select and optimize cloud data platforms (Databricks, Big Query, Snowflake, Azure/AWS/GCP).
- Design Lakehouse architectures leveraging Delta Lake and Apache Spark.
- Build scalable ETL/ELT pipelines using Databricks (Delta Lake, Auto Loader, DLT).
- Implement ingestion patterns for batch, micro-batch, and streaming workloads.
- Optimize Spark jobs, Databricks SQL workloads, and Big Query queries.
- Implement data governance frameworks: lineage, cataloging, metadata, MDM.
- Configure Databricks Unity Catalog for access control, auditing, and PII masking.
- Enforce compliance standards (GDPR, HIPAA, SOC2) across data platforms.
- Integrate BI tools (Power BI, Tableau, Looker) with Databricks and Big Query.
- Build SQL dashboards and KPI monitoring solutions.
- Ensure data models support analytics, reporting, and ML/AI use cases.
- Partner with engineering, analytics, and product teams to deliver scalable data solutions.
- Mentor data engineers and lead architectural reviews.
Required Skills & Experience
Typically, 8+ years of experience in data architecture or engineering roles
Technical Skills
- Robust expertise in Databricks (Delta Lake, Spark, Unity Catalog).
- Hands-on experience with Google BigQuery and cloud-native data services.
- Proficiency in Python, PySpark, SQL.
- Experience with ETL/ELT tools (dbt, Airflow, Dataflow, Glue).
- Knowledge of BI tools (Power BI, Tableau, Looker).
📌 Data Architect (Bengaluru)
🏢 HCL INDIA
📍 Bengaluru