Forward Deployed Engineer II - Data & AI Engineer (Databricks & AWS)
Location: Bengaluru / Delhi / Mumbai / Hyderabad / Hybrid
Employment Type: Full-Time
Experience: 6+ Years
About the Role
Avashya is looking for a Data & AI Engineer – Databricks & AWS with deep hands-on expertise in building, optimizing and modernizing enterprise data and AI platforms.
This is a hands-on engineering and customer-facing role for someone who understands Databricks deeply, has strong AWS expertise, and can make pragmatic architectural decisions across Data Engineering, ML and Generative AI.
You will work with customer engineering and architecture teams to assess existing platforms, identify performance and cost optimization opportunities, design up-to-date data and AI architectures, and implement solutions that deliver measurable business outcomes.
Key Responsibilities
- Design, build and optimize Databricks-based data and AI platforms across data engineering, analytics, ML and GenAI workloads.
- Deep-dive into Databricks performance and cost,
identify bottlenecks and implement measurable optimization improvements.
- Design scalable data pipelines, lakehouse architectures, data models and real-time/batch processing solutions using Python, SQL, PySpark, Spark and Delta Lake.
- Apply deep understanding of Spark internals, query execution, partitioning, shuffles, caching, joins and cluster configuration to optimize workloads.
- Design and implement ML and MLOps solutions using MLflow, model development, deployment and monitoring.
- Build GenAI solutions including LLM applications, RAG, vector search, embeddings and AI agents.
- Architect and implement AWS-based data and AI solutions using services such as S3, Glue, Athena, Redshift, EMR, Kinesis, Lambda, Step Functions, DMS, SageMaker, Bedrock and IAM.
- Evaluate and map Databricks capabilities to AWS-native services, recommending the appropriate platform based on workload, architecture, performance, cost and operational requirements.
- L
📌 Forward Deployed Engineer II (India)
🏢 Avashya
📍 India