17 Aug
|
Vriba Solutions
|
Bengaluru
17 Aug
Vriba Solutions
Bengaluru
Job Description 2 – Lead Data Engineer
Lead Data Engineer
Position Title: Lead Data Engineer
Function: Technology
Experience: 8–12 Years
Location: Bangalore, India
Reporting: Individual Contributor (No Direct Reports)
Role Summary
The Lead Data Engineer is responsible for designing, building, and managing scalable, AI-ready data solutions and products while enabling enterprise analytics, machine learning, and Agentic AI capabilities. The role emphasizes modern cloud data engineering, governance, semantic layers, cost optimization, and collaboration with business and technology stakeholders.
Key Responsibilities
Design, build, and manage scalable, AI-ready data solutions and products.
Develop and maintain robust semantic layers and data models.
Ensure high standards of data quality, reliability, and governance.
Enable Machine Learning and Agentic AI capabilities across the data platform.
Collaborate closely with business and technology stakeholders.
Drive operational efficiency and cost optimization through data-driven solutions.
Mandatory Technical Skills
Deep understanding of modern data engineering principles and big data ecosystems.
Strong experience with cloud platforms (AWS, Azure, GCP).
Ability to design scalable, resilient, cost-efficient, and agentic data solutions.
Robust proficiency in Python, PySpark, and SQL.
Hands-on experience with Snowflake, Databricks, Spark, Dataproc, BigQuery, or Synapse.
Experience with Kafka, Kinesis, Event Hub, Dataflow, or similar streaming technologies.
Experience with orchestration platforms such as Apache Airflow or Astronomer.
Experience with CI/CD and DataOps practices.
Experience with data governance, metadata management, data modeling, and data quality.
Hands-on experience with data platform engineering and administration.
Exposure to Agentic AI, LLM integrations, and orchestration frameworks.
Good-to-Have Skills
Multi-cloud exposure.
Observability and monitoring tools.
API and Microservices-based data integrations.
📌 Lead Data Engineer (Bengaluru)
🏢 Vriba Solutions
📍 Bengaluru