AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimisation of modern data pipelines and cloud-native platforms. This role is ideal for someone with deep experience building scalable batch and streaming data workflows across cloud and lakehouse environments, robust hands-on engineering skills, and a drive to mentor junior engineers.

You will work closely with AI engineers, solution architects, and cross-functional teams to build production-grade pipelines spanning ingestion, transformation, and curated data delivery — enabling high-quality data for AI and analytics use cases at scale.

Location: Bangalore / Mumbai / Hyderabad / Gurgaon (Hybrid — 3 days in office)

Responsibilities

• Design and build scalable batch and streaming data pipelines across bronze, silver, and gold medallion layers.

• Build historical and incremental ingestion using Auto Loader/Spark Structured Streaming/Kafka feeds, with GCS/Azure/AWS storage and Databricks Jobs orchestration.





• Develop and maintain Databricks-based pipelines using Spark and Delta Lake for lakehouse architecture, including migration of legacy or on-premises data sources.

• Design and maintain analytical data layers in BigQuery or Databricks SQL, applying best practices in partitioning, clustering, and performance tuning.

• Implement SQL/PySpark transformations for wide and semi-structured data, including wide-to-long processing and typed or hybrid models suited to consumer requirements.

• Collaborate with AI engineers and data scientists to build pipelines that feed ML models, AI agents, and analytical systems.

• Implement data governance, quality controls, and security best practices including schema enforcement, lineage tracking, and access controls.

• Drive engineering best practices across CI/CD, testing, monitoring, and pipeline observability.

• Partner with solution architects to translate data requirements into technical designs.

• Mentor junior data engineers and contribute

📌 Data Engineer- GCP/Databricks (Bengaluru)
🏢 AuxoAI
📍 Bengaluru