Remote: Hybrid

Job Description (JD)Lead / Senior Data EngineerLocation:Hyderabad, IndiaExperience:8+ YearsEmployment Type:Full-TimeNotice Period : Immediate / 15 Days.About the RoleWe are looking for a highly skilled and results-drivenLead / Senior Data Engineerwith extensive experience in designing, developing, and managing enterprise-scale data platforms across Azure and AWS cloud ecosystems. The ideal candidate will bring solid expertise inAzure Databricks, Snowflake, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Azure Data Factory, Python, PySpark, and SQL , combined with proven leadership experience in delivering modern data warehouse and lakehouse solutions.This role requires a hands-on technical leader who can drive architecture decisions, build scalable and governed data platforms, mentor engineering teams, and collaborate closely with business stakeholders to deliver data-driven solutions that enable analytics, reporting, and AI/ML initiatives.Key ResponsibilitiesData Architecture & EngineeringDesign, develop, and maintain scalable and high-performance ETL/ELT pipelines using Azure Data Factory, Azure Databricks, Python, PySpark, and SQL.Build metadata-driven and parameterized data ingestion frameworks supporting both batch and real-time processing.Architect modern Lakehouse and Data Warehouse solutions leveraging Azure and AWS cloud technologies.Develop analytics-ready datasets and enterprise data products for business intelligence, reporting, and advanced analytics use cases.Implement robust data quality frameworks, reconciliation processes, and validation controls.Azure Databricks & Lakehouse DevelopmentDesign and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake.Build and manage Delta Live Tables (DLT) pipelines for reliable and quality-enforced data processing.Develop PySpark and Spark SQL transformations for large-scale data workloads.Implement Unity Catalog governance, including data lineage, auditing, metadata management, and fine-grained access controls.Optimize Databricks workloads through partitioning strategies,



caching, broadcast joins, Adaptive Query Execution (AQE), and data-skew handling.Snowflake Data WarehousingDesign and implement Snowflake-based data warehouse solutions.Develop and optimize Snowflake schemas, data models, RBAC frameworks, and data ingestion processes using Snowpipe and COPY operations.Perform SQL query tuning, warehouse sizing, performance optimization, and cost management.Support reporting, analytics, and enterprise BI workloads through scalable and efficient data models.Cloud & Streaming SolutionsDevelop real-time and event-driven data processing solutions using Azure Event Hubs, AWS Kinesis, Azure Functions, and AWS Lambda.Build scalable ingestion frameworks for streaming and batch data sources.Support hybrid and multi-cloud data ecosystems across Azure and AWS platforms.Data Modeling & GovernanceDesign dimensional data models using Star Schema and Snowflake Schema methodologies.Implement Slowly Changing Dimensions (SCD Type 1, 2, and 3).Support Data Mesh and domain-oriented data product initiatives.Establish enterprise data governance practices, security controls, and data stewardship standards.DevOps & AutomationDevelop and maintain CI/CD pipelines using Azure DevOps and GitHub Actions.Implement automated deployment, monitoring, testing, and release management processes.Promote engineering best practices through code reviews, version control standards, and development frameworks.Leadership & Stakeholder ManagementLead technical design discussions, architectural reviews, and project delivery activities.Mentor and guide data engineering teams through technical coaching and knowledge sharing.Collaborate with business stakeholders,



architects, data scientists, and analytics teams to define and implement data solutions.Drive technical strategy and ensure successful project execution from design through production support.Required QualificationsEducationBachelor's Degree in Computer Science, Information Technology, Engineering, or a related discipline.Experience8+ years of experience in Data Engineering, Data Warehousing, and Cloud Data Platforms.Proven experience leading enterprise data transformation and modernization initiatives.Strong track record of delivering scalable data solutions in Azure cloud environments.Technical SkillsCloud PlatformsMicrosoft AzureAmazon Web Services (AWS)Azure TechnologiesAzure DatabricksAzure Data Factory (ADF)Azure Synapse AnalyticsAzure Data Lake Storage Gen2 (ADLS Gen2)Azure SQL DatabaseAzure Event HubsAzure FunctionsMicrosoft FabricDatabricks & Data GovernancePySparkSpark SQLDelta LakeDelta Live Tables (DLT)Unity CatalogDatabricks WorkflowsData WarehousingSnowflakeAzure Synapse AnalyticsAmazon RedshiftProgramming LanguagesPythonPySparkSQL / T-SQLPandasAWS ServicesAWS GlueAmazon S3Amazon AthenaAWS LambdaAWS Step FunctionsAWS IAMAmazon CloudWatchData ModelingMedallion ArchitectureStar Schema & Snowflake SchemaData WarehousingData MeshLakehouse ArchitectureSCD Type 1, Type 2, and Type 3DevOps & CollaborationAzure DevOpsGitHub ActionsGit Version ControlAgile/Scrum MethodologiesPreferred QualificationsDatabricks Certification (Associate/Professional).Snowflake Certification.Microsoft Azure Data Engineering Certifications.Experience supporting AI/ML and advanced analytics workloads.Experience implementing enterprise data governance frameworks.Exposure to Microsoft Fabric and modern Lakehouse platforms.Key CompetenciesTechnical LeadershipSolution ArchitectureData Engineering Best PracticesPerformance OptimizationProblem Solving & Root Cause AnalysisStakeholder ManagementTeam Mentoring & CoachingStrategic Decision MakingCommunication & Collaboration

📌 Senior Data Engineer (Mumbai)
🏢 Anblicks
📍 Mumbai