19 Nov
|
Accord Infosystems
|
Mumbai
19 Nov
Accord Infosystems
Mumbai
Role & responsibilities
Key Responsibilities:-
1. Enterprise Data Modeling & Architecture
- Lead the design and implementation of enterprise-wide Fact and Dimensional Models across multiple business domains.
- Establish a Single Version of Truth through standardized data definitions, conformed dimensions and consistent data grains.
- Drive enterprise data modeling using Kimball methodology, Star Schema, Snowflake Schema and Data Vault 2.0.
- Build scalable semantic layers and reusable domain-oriented data products.
2. Databricks Lakehouse Engineering
- Design and maintain scalable ETL/ELT pipelines using Databricks, Apache Spark and PySpark.
- Implement Delta Lake, Delta Live Tables (DLT) and Databricks Workflows.
- Drive data processing from raw ingestion through curated and business-ready data layers.
- Optimize large-scale Spark jobs handling billions of records.
3. Data Governance & Security
- Implement data governance, access controls and end-to-end data lineage using Unity Catalog.
- Ensure data quality, consistency, security and regulatory compliance.
- Establish enterprise data standards and reusable engineering frameworks.
4. AI Integration & Automation
- Drive AI-enabled engineering practices and automation across the data engineering lifecycle.
- Explore and implement Agentic Engineering capabilities to improve productivity and operational efficiency.
- Build AI-ready data platforms supporting advanced analytics and intelligent applications.
5. Business & Stakeholder Collaboration
- Work closely with business and technology leaders across Retail, Corporate, Risk and Wealth Management.
- Translate business requirements into scalable enterprise data architecture and data products.
- Provide technical direction and mentor engineering teams.
Technical Skills & Expertise
- Databricks: Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows.
- Big Data: Apache Spark, PySpark and Python.
- Data Modeling: Kimball Methodology, Fact & Dimensional Modeling, Star Schema, Snowflake Schema, Data Vault 2.0.
- Data Warehousing: Enterprise Data Warehouse, Semantic Layer, Conformed Dimensions and SCD Type 1/2/3.
- Cloud Platforms: Azure (ADLS Gen2, Synapse) or AWS (S3, EMR).
- Engineering Practices: CI/CD, DataOps, Data Quality and Data Observability.
- Governance: Unity Catalog, Data Lineage and Fine-Grained Access Controls.
- AI & Automation: AI-enabled Data Engineering and Agentic Engineering.
Candidate Requirements:
- BE / BTech in Computer Science, Information Technology or a relevant engineering discipline.
- 1520 years of overall experience in Data Engineering and Data Architecture.
- Minimum 5 years of experience in senior technical leadership / architecture roles.
- Strong experience working with Banking / Financial Services institutions.
- Proven experience designing enterprise-scale data platforms and dimensional data models.
- Robust hands-on expertise in Databricks, Spark, PySpark and Python.
- Experience leading large-scale data engineering initiatives and cross-functional teams.
📌 Lead Data Engineer (Mumbai)
🏢 Accord Infosystems
📍 Mumbai