Description
• Assist the team with development and operation of cloud-based data platforms and pipelines along with ETL/ELT functions, cloud database migrations and management, support downstream analytics and BI use cases, as those skills are established and team needs identified.
• Assist the team on call representative and address issues as needed.
• Proactively communicate with business users, stakeholders, technical peers, and project teams.
• Learn and apply industry trends, concepts, and techniques to meet organizational requirements
• Design and implement real-time streaming pipelines using Flink or ksqlDB, backed by Kafka/Confluent Cloud.
• Develop integration/services using C#/.NET Core (REST APIs, JSON, Azure Functions, console apps, services, etc.).
• Build scalable ETL/ELT pipelines on modern tooling (Databricks, Snowflake, Fabric, etc.)
• Orchestrate batch pipelines with Databricks Jobs/Workflows, SSIS, Azure Data Factory, or equivalent tools.
• Partner with stakeholders to translate requirements into robust data solutions; provide documentation and guidance.
• Participate in agile ceremonies and contribute to continuous improvement.
• Experience with Delta Lake, Apache Iceberg, or Parquet as part of up-to-date Lakehouse architecture.
• Experience in T-SQL programming and general knowledge of SQL Server.
• Familiarity with AI-assisted development tools and their application in data engineering workflows.
• Experience in Source Control (GIT, Evolve/Flyway), desired.
• Experience with Azure cloud services (Data Factory, Key Vault, Storage Accounts, Azure DevOps, Event Hubs, Functions, Container Apps), desired.
• Experience with SSIS or Azure Data Factory for legacy ETL systems, desired.
• Perform reviews of development team data transformations, models and queries.
• Define and manage topics, partitions, schemas, retention, and consumer group strategies, leveraging Schema Registry and data contracts.
• Integrate data and automation systems
📌 Database Engineer (Pune)
🏢 Mouser
📍 Pune