We are seeking a Senior Data Engineer to operate & design, manage & maintain, and optimize our data platform. In this role, you will bridge the gap between traditional big data engineering and modern Generative AI infrastructure. You will be responsible for building robust data pipelines on Databricks, engineering high-quality datasets for AI models, and implementing retrieval architectures.

Key Responsibilities

Data Architecture: Design scalable distributed data processing systems.
Pipeline Development: Build ETL/ELT pipelines for complex datasets.
AI Integration: Implement and fine-tune generative AI capabilities.
App Engineering: Develop backend services to expose data products.
System Optimization: Improve code performance, data quality, and storage efficiency.
Mentorship: Guide junior engineers and advocate for technical best practices.

Required Technical Skills

Primary Expertise (Expert Level)

Data Engineering: Apache Spark, Hadoop, Kafka, and Databricks/Delta Lake.
Python Ecosystem: PySpark, Pandas, NumPy, and performance tuning.
Cloud Platforms:



Advanced deployment experience within AWS or Azure.
Data Modeling: Expert knowledge of relational and non-relational databases.

Secondary Expertise (Intermediate Level)

GenAI / LLMs: Experience with LangChain, LlamaIndex, and vector databases (e.g., Pinecone, Milvus).
Application Engineering: Building APIs using FastAPI, Flask, or Node.js.
DevOps / MLOps: Containerization via Docker, Kubernetes, and CI/CD deployment workflows.

Qualifications

Education: Bachelor's degree in Computer Science or a related field.
Experience: 7+ years of skilled software engineering experience.
Portfolio: Proven track record of shipping production-grade data pipelines.

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly,

📌 Senior Data Engineer (Bengaluru)
🏢 Adobe
📍 Bengaluru