About the Company

ThreatXInte l is a fast-growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions. Our expertise spans cloud security, web & mobile application security testing, DevSecOps, vulnerability assessments, IT consulting, and professional staffing services.

We support global corporate clients by deploying skilled professionals across IT and finance domains, helping organizations strengthen compliance, optimize operations, and scale efficiently.

About the role

We are looking for an experienced AWS Databricks Data Engineer to join our team on a remote freelance contract . The ideal candidate will have strong expertise in Databricks, PySpark, Delta Lake, SQL, and AWS , with experience building scalable data pipelines and modern lakehouse solutions. Experience in the Healthcare Payer domain (MMIS) is highly preferred.

AWS Databricks Data Engineer

Location: Remote

Job Type: Freelance / Contract

Key Responsibilities

- Design and develop scalable batch and streaming data pipelines using PySpark , Delta Lake , Auto Loader , and Delta Live Tables (DLT) .
- Build and optimize cloud-native data solutions on AWS using S3 , IAM , AWS Glue ,



and AWS Lambda .
- Implement data governance, security, and lineage using Databricks Unity Catalog .
- Automate data pipeline deployments using Databricks Workflows , Apache Airflow , and CI/CD tools .
- Collaborate with business and technical teams to develop feature stores and prepare high-quality datasets for analytics and reporting.
- Optimize data processing performance and ensure data quality across enterprise platforms.

Required Skills
- 3–5 years of hands-on experience with Databricks
- Strong expertise in PySpark and Advanced SQL
- Experience with Apache Spark and Delta Lake
- Robust AWS experience ( S3, IAM, Glue, Lambda )
- Experience with Unity Catalog
- Knowledge of Delta Live Tables (DLT) and Auto Loader
- Experience with Apache Airflow
- CI/CD experience using GitHub or GitLab
- Healthcare Payer/MMIS domain experience is highly preferred

Interested candidates, please share:

- Updated Resume
- Total Experience
- Relevant Databricks Experience
- AWS Experience
- Healthcare/MMIS Experience
- Current Location
- Notice Period
- Availability for Interview

📌 AWS Databricks Data Engineer | Remote | Freelance (India)
🏢 ThreatXIntel
📍 India