12 Aug
|
WebSenor InfoTech
|
India
12 Aug
WebSenor InfoTech
India
Job Overview
We are seeking an experienced Data Modeler with strong expertise in Databricks, Delta Lake, Lakebase, cloud data platforms, and Oracle-to-cloud database migration.
The ideal candidate will have hands-on experience designing scalable conceptual, logical, and physical data models, modernizing Oracle workloads, implementing data governance and metadata management practices, and developing AI/ML-ready data products.
The candidate will work closely with data engineers, architects, business stakeholders, governance teams, and analytics/AI teams to design reliable, scalable, governed, and high-performance data solutions.
Key Responsibilities
- Design and maintain conceptual, logical, and physical data models for enterprise data platforms.
- Design scalable data models using Databricks Delta Lake and Lakebase.
- Work with Databricks Unity Catalog for metadata management, governance, access control, and data discovery.
- Implement and support Delta Sharing for secure and governed data sharing.
- Develop data structures supporting both analytical and transactional/operational workloads.
- Participate in Oracle database modernization and migration initiatives.
- Analyze existing Oracle schemas, stored procedures, dependencies, data structures, and workloads to determine appropriate cloud migration strategies.
- Design and migrate Oracle workloads to modern platforms such as:
- Databricks Delta Lake
- Snowflake
- Azure SQL Database
- Azure Synapse Analytics
- PostgreSQL
- MongoDB
- Other cloud-native database platforms
- Develop mapping specifications and transformation rules for source-to-target migrations.
- Work with ETL/ELT teams using Azure Data Factory, dbt, Informatica, Fivetran, or equivalent technologies.
- Collaborate with data engineers to ensure data models are optimized for ingestion, transformation, reporting, analytics, and downstream applications.
- Implement data governance standards covering metadata, lineage, data ownership, business definitions, and data classification.
- Work with governance platforms such as Microsoft Purview, Collibra, Alation, or Informatica EDC.
- Define and implement data quality rules, validation frameworks, and reconciliation processes.
- Support master data management (MDM)
and reference-data initiatives.
- Maintain data lineage and traceability across source, transformation, and target systems.
- Optimize data models for scalability, performance, storage efficiency, and query performance.
- Support development of AI/ML-ready datasets and data products.
- Design data structures that support feature engineering, machine learning pipelines, and advanced analytics.
- Collaborate with Data Scientists and ML Engineers to understand feature and model data requirements.
- Participate in architecture reviews, technical design discussions, and data modeling standards.
- Document data models, mappings, metadata, lineage, business rules, and migration specifications.
- Support production issues, data reconciliation, and post-migration validation.
Required Skills & Experience
- 5–8 years of experience in data modeling, database architecture, data engineering, or related roles.
- Strong hands-on experience with:
- Databricks
- Delta Lake
- Databricks Unity Catalog
- Experience with Databricks Lakebase or cloud-native transactional/operational database technologies.
- Robust understanding of:
- Dimensional modeling
- Star and Snowflake schemas
- Normalization/denormalization
- Fact and dimension modeling
- Slowly Changing Dimensions (SCD)
- Enterprise data modeling
- Strong experience with Oracle databases and Oracle-to-cloud migration.
- Experience migrating Oracle workloads to one or more of:
- Databricks Delta Lake
- Snowflake
- Azure SQL
- Azure Synapse
- PostgreSQL
- MongoDB
- Experience with at least one major cloud platform: Azure, AWS, or GCP.
- Hands-on experience with ETL/ELT technologies such as ADF, dbt, Informatica, Fivetran, or equivalent.
- Strong SQL skills and understanding of database performance optimization.
- Experience with data governance and metadata management.
- Familiarity with Microsoft Purview, Collibra, Alation, or Informatica EDC.
- Strong understanding of data quality, data lineage, metadata management, and master data management.
- Experience designing datasets for analytics and AI/ML use cases.
- Understanding of feature engineering and ML data requirements.
Preferred Qualifications
- Experience in healthcare, financial services, insurance, banking, or other highly regulated industries.
- Experience with HIPAA, PCI-DSS, SOX, GDPR, or similar regulatory requirements.
- Experience implementing enterprise data governance frameworks.
- Experience with Databricks Delta Sharing.
- Experience with cloud-native transactional databases and operational data platforms.
- Experience with data cataloging and automated lineage.
- Experience supporting enterprise-scale Oracle modernization programs.
- Knowledge of CDC, incremental data processing, and real-time data integration.
- Experience working with AI/ML teams to create feature-ready datasets.
- Databricks or cloud data platform certifications are a plus.
Technical SkillsCategoryTechnologiesData PlatformDatabricks, Delta Lake, LakebaseGovernanceUnity Catalog, Purview, Collibra, Alation, Informatica EDCCloudAzure, AWS, GCPETL/ELTADF, dbt, Informatica, FivetranDatabasesOracle, PostgreSQL, Azure SQL, MongoDBCloud WarehousingSnowflake, Azure SynapseData SharingDelta SharingModelingDimensional Modeling, Star Schema, Snowflake Schema, SCDData ManagementData Quality, Lineage, MDM, Metadata ManagementAI/MLFeature Engineering, ML-ready Data ProductsKey Competencies
- Enterprise Data Modeling
- Oracle Cloud Migration
- Databricks Lakehouse
- Delta Lake
- Lakebase
- Data Governance
- Metadata Management
- Data Lineage
- Data Quality
- Master Data Management
- Cloud Data Architecture
- AI/ML Data Products
- Database Modernization
- Performance Optimization
Education
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, Computer Engineering, or a related field.
- Relevant professional certifications in Databricks, Azure, AWS, GCP, or data management are preferred.
Work Location: Remote
📌 Data Modeler (India)
🏢 WebSenor InfoTech
📍 India