21 Aug
|
IRIS SOFTWARE
|
Noida
21 Aug
IRIS SOFTWARE
Noida
Job Title
Databricks - Lead
Posted OnLocation
Noida
Responsibilities
- Define and drive enterprise data engineering strategy aligned with organizational objectives and data modernization initiatives.
- Establish data engineering standards, governance frameworks, and best practices across teams.
- Lead the design of enterprise-scale data processing architectures using PySpark and modern data platform technologies.
- Define enterprise standards for Snowflake and Delta Lake-based data platforms supporting analytical and operational workloads.
- Drive real-time and event-driven data architecture initiatives using Apache Kafka or Amazon Kinesis.
- Establish governance standards for data ingestion, transformation, streaming, and processing frameworks.
- Define workflow orchestration, scheduling, and operational governance standards using Apache Airflow or Databricks Workflows.
- Establish data quality, validation, monitoring, and operational excellence frameworks across data engineering ecosystems.
- Define enterprise standards for data products, data quality ownership,
metadata management, discoverability, and trusted business data consumption across the organization.
- Establish architecture standards for contemporary Lakehouse platforms, data observability, platform engineering, and scalable cloud-native data ecosystems supporting enterprise analytics and AI initiatives.
- Define AI-ready data foundation strategies supporting structured and unstructured data processing, vector-enabled architectures, retrieval patterns, and future GenAI and Agentic AI initiatives.
- Partner with business stakeholders to translate business objectives into scalable data platform capabilities, data products, and enterprise data architecture decisions.
- Drive adoption of AI-assisted engineering practices across data engineering teams to improve developer productivity, code quality, documentation, testing, and delivery effectiveness while maintaining governance standards.
- Lead architecture
📌 Databricks - Lead (Noida)
🏢 IRIS SOFTWARE
📍 Noida