Hi,

Greetings from CALLISTOFUSION

We have a 6-18 months (possibilities of further extension) contract requirement for Databricks Architect 100% Remote Work

Job Title: Databricks Architect

Location: 100% Remote Work from Home

Job Type: 6-18 months (possibilities of further extension)

Working Hours: 5:00 PM IST to 1:00 AM IST (8-hour shift)

Night shift to align with client onshore hours (primarily US East Coast timings). Flexibility for occasional extended hours during critical deliveries or go-lives.

Salary: 18-25 LPA DOE

About the Role

We are seeking an experienced Databricks Architect to join our offshore delivery team on a contract basis. In this role, you will design, architect, and guide the implementation of scalable, secure, and high-performance Lakehouse platforms using Databricks (primarily on Azure, AWS, or multi-cloud). You will work closely with onshore architects, data engineers, data scientists, and client stakeholders during overlapping hours to deliver enterprise-grade data engineering, analytics, and AI/ML solutions.

This is a hands-on technical architect position with solid emphasis on solution design, best practices, performance optimization, governance, and mentoring offshore team members.

Key Responsibilities

- Lead end-to-end Databricks platform architecture for large-scale data ingestion, processing, storage, transformation, and analytics workloads.
- Design scalable Lakehouse architectures using Delta Lake, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows (Jobs/Orchestration), and MLflow.
- Define cluster management strategies (autoscaling, spot instances, policies, cost optimization) and governance models (Unity Catalog,



access controls, data lineage).
- Architect integration patterns with cloud services (e.g., Azure ADLS Gen2 / AWS S3, Azure Synapse / Snowflake, Kafka, Event Hubs, Power BI / Tableau).
- Provide technical leadership in migrating legacy data platforms (Hadoop, traditional EDW) to Databricks Lakehouse.
- Create architecture diagrams, solution blueprints, high-level/low-level designs, and documentation (including cost estimates and performance benchmarks).
- Collaborate with onshore teams and clients during live sessions to gather requirements, conduct design reviews, present PoCs, and resolve technical blockers.
- Optimize Spark jobs (PySpark/Scala), query performance, and cost-efficiency (e.g., partitioning, Z-ordering, liquid clustering, photon engine).
- Establish best practices for CI/CD (Databricks Repos, Git integration, DevOps pipelines), security (RBAC, encryption, private endpoints), and compliance (GDPR, HIPAA if applicable).
- Mentor offshore developers/engineers, conduct code/design reviews, and support knowledge transfer.
- Troubleshoot complex production issues and participate in incident resolution during shift hours.

Required Skills & Experience:
- 8+ years of overall data architecture / big data experience,



with at least 4–5 years hands-on in Databricks (must-have).
- Strong expertise in Apache Spark (PySpark preferred; Scala a plus), Delta Lake, Unity Catalog, Databricks SQL, Delta Live Tables, and Databricks Workflows.
- Deep understanding of Lakehouse paradigm and modern data platforms (Medallion architecture, data mesh principles).
- Experience with cloud platforms — preferably Azure Databricks (common in offshore contracts), but AWS/GCP Databricks also acceptable.
- Proficiency in Python, SQL, and scripting for automation.
- Hands-on experience with orchestration tools (Databricks Workflows, Azure Data Factory, Airflow) and streaming (Structured Streaming, Kafka integration).
- Solid knowledge of data governance, security, cost optimization, and performance tuning in Databricks.
- Experience in client-facing roles, solutioning, pre-sales support, or leading technical workshops.
- Excellent communication skills (verbal & written English) for client interactions, design discussions, and status reporting during night shift.

Nice-to-Have:
- Databricks certifications (e.g., Certified Data Engineer Professional, Certified Machine Learning Professional, or Lakehouse Platform accreditations).
- Exposure to ML/AI workloads (MLflow, Feature Store, Mosaic AI).
- Experience with Terraform / Infrastructure as Code, CI/CD (Azure DevOps, GitHub Actions).
- Domain knowledge in BFSI, retail, healthcare, or manufacturing (common for offshore engagements).

What We Offer

- Fully remote / work-from-home setup.
- Opportunity to work on cutting-edge Databricks implementations for global client.

📌 Databricks Architect (India)
🏢 Callistofusion
📍 India