04 Aug
|
Birlasoft
|
Pune
Data Architect (Snowflake &
- Databricks) Area(s) of responsibility Skills: Data Architect (Snowflake &
- Databricks) Experience: 16 years Location: Noida/ Mumbai/ Pune/ Bangalore/ Hyderabad/ Chennai Role Overview: We are seeking a highly experienced Data Architect with deep expertise in modern cloud data platforms, specifically Snowflake and Databricks. The ideal candidate will be responsible for designing, developing, and governing scalable, high-performance data architectures that support advanced analytics, AI/ML, and enterprise data initiatives. This role requires a strategic thinker who can translate business requirements into robust technical solutions while ensuring data quality, security, and scalability.
Key Responsibilities
- Design and implement end-to-end data architecture across Snowflake and Databricks platforms.
- Define data modeling standards including dimensional, normalized, and Data Vault models.
- Architect scalable data lakes, lakehouses, and data warehouses using best practices.
- Lead data integration strategies using ETL/ELT frameworks leveraging tools like ADF, dbt, and Spark.
- Optimize performance and cost across Snowflake and Databricks environments.
- Implement data governance, security, lineage, and compliance frameworks.
- Enable real-time and batch data processing architectures.
- Collaborate with business stakeholders to align data strategy with business goals.
- Mentor engineering teams and enforce architectural standards.
Technical
Skills &
- Expertise • Strong expertise in Snowflake: architecture design, Snowpipe, Streams/Tasks, performance tuning, and data sharing.
- Advanced knowledge of Databricks: Delta Lake, Lakehouse architecture, Spark (PySpark/Scala), and performance optimization.
- Experience with Databricks features such as Unity Catalog,
Delta Live Tables, MLflow, and Mosaic AI.
- Proficiency in SQL, Python, and distributed data processing frameworks.
- Hands-on experience with cloud platforms (Azure/AWS/GCP) and related services.
- Strong understanding of data ingestion, transformation, orchestration, and data warehousing concepts.
- Experience with data visualization tools such as Power BI, Tableau, or Qlik. Architecture &
- Design Capabilities • Design hybrid architectures leveraging Snowflake for warehousing and Databricks for advanced analytics and ML workloads.
- Define data lakehouse strategies integrating structured, semi-structured, and unstructured data.
- Build event-driven, real-time data pipelines.
- Establish reusable frameworks for ingestion, transformation, and consumption. Data Governance &
- Security • Implement robust data governance frameworks including cataloging, lineage, and data quality controls.
- Ensure compliance with enterprise security policies and regulatory requirements.
- Define access control strategies using role-based and attribute-based access.
Qualifications &
Experience • 10 years of overall experience in data engineering and architecture.
- Proven experience working with both Snowflake and Databricks in enterprise environments.
- Solid experience in designing large-scale data platforms and migration strategies.
- Experience in AI/ML data pipeline enablement is highly preferred.
- Relevant certifications in Snowflake, Databricks, or cloud platforms are a plus. Soft Skills • Strong stakeholder management and communication skills.
- Ability to translate complex technical concepts into business outcomes.
- Leadership skills with experience managing cross-functional teams.
- Strong problem-solving and analytical thinking abilities.
Experience Level Senior Level
📌 Senior Data Architect - Snowflake & Databricks (Pune)
🏢 Birlasoft
📍 Pune