2 – Lead Data Engineer

Lead Data Engineer

Position Title: Lead Data Engineer

Function: Technology

Experience: 8–12 Years

Location: Bangalore, India

Reporting: Individual Contributor (No Direct Reports)

Role Summary The Lead Data Engineer is responsible for designing, building, and managing scalable, AI-ready data solutions and products while enabling enterprise analytics, machine learning, and Agentic AI capabilities. The role emphasizes modern cloud data engineering, governance, semantic layers, cost optimization, and collaboration with business and technology stakeholders.

Key Responsibilities

- Design, build, and manage scalable, AI-ready data solutions and products.
- Develop and maintain robust semantic layers and data models.
- Ensure high standards of data quality, reliability, and governance.
- Enable Machine Learning and Agentic AI capabilities across the data platform.
- Collaborate closely with business and technology stakeholders.
- Drive operational efficiency and cost optimization through data-driven solutions.

Mandatory Technical Skills

- Deep understanding of modern data engineering principles and big data ecosystems.
- Strong experience with cloud platforms (AWS, Azure, GCP).
- Ability to design scalable, resilient, cost-efficient, and agentic data solutions.
- Strong proficiency in Python, PySpark, and SQL.
- Hands-on experience with Snowflake, Databricks, Spark, Dataproc, BigQuery, or Synapse.
- Experience with Kafka, Kinesis, Event Hub, Dataflow, or similar streaming technologies.




- Experience with orchestration platforms such as Apache Airflow or Astronomer.
- Experience with CI/CD and DataOps practices.
- Experience with data governance, metadata management, data modeling, and data quality.
- Hands-on experience with data platform engineering and administration.
- Exposure to Agentic AI, LLM integrations, and orchestration frameworks.

Good-to-Have Skills

- Multi-cloud exposure.
- Observability and monitoring tools.
- API and Microservices-based data integrations.
- Power BI.
- Retail Domain Experience.
- React UI development exposure.

Position Scope

- 5+ years of experience designing and managing large-scale data systems.
- Strong experience with data modeling and scalable data warehouse solutions.
- Expertise in data pipelines and integration frameworks.
- Experience deriving business insights from enterprise data.
- Strong business acumen.
- Experience implementing governance, privacy, and security best practices.
- Experience with Git, Agile, and SDLC.
- Strong stakeholder management and communication skills.

Key Traits

- Strong analytical and problem-solving skills.
- Ability to translate business requirements into technical solutions.
- Ability to evaluate architectural trade-offs.
- Robust focus on cloud cost optimization.
- Ownership mindset toward platform stability and SLA adherence.
- Strong decision-making in evolving environments.
- Effective communication and stakeholder management.

📌 Lead Data Engineer (Bengaluru)
🏢 Vriba Solutions
📍 Bengaluru