12 Nov
|
Quantzig
|
Bengaluru
12 Nov
Quantzig
Bengaluru
About Quantzig:
Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and operated by high-performance champions
If you have what it takes to be the champion with business and functional skills to take ownership of an entire project end-to-end, help build a team with great work ethic and a drive to learn, you are the one were looking for. The clients love us for our solutioning capability, our enthusiasm and we expect you to be a part of our growth story.
Company Website: https://www.quantzig.com/
:
We are looking for an experienced Data Engineer Lead with strong hands-on expertise in Databricks, PySpark, SQL, and AWS Cloud to build and optimize scalable ETL pipelines and data solutions, preferably within the US Healthcare domain.
Key Responsibilities:
- Design, develop, and optimize ETL pipelines using Databricks, PySpark, and SQL.
- Migrate existing AWS EC2 and Redshift-based ETL workloads to Databricks.
- Work with Unity Catalog, Delta Lake, and data orchestration tools.
- Build and maintain data ingestion, transformation, and validation processes.
- Orchestrate workflows using Apache Airflow or Databricks Workflows.
- Support healthcare analytics, patient access, spend analytics, and commercial reporting.
- Ensure production deployment, monitoring, performance optimization, and data quality.
Must-Have Skills:
- 7+ years of experience in Data Engineering.
- Strong hands-on experience in Databricks, PySpark, and SQL.
- Valuable experience with AWS Cloud, EC2, and Redshift.
- ETL pipeline development and data migration experience.
- Unity Catalog and Airflow / Databricks Workflows.
- Exposure to US Healthcare datasets.
Good to Have:
- IQVIA Claims, MMIT datasets, NBRx, TRx.
- CI/CD GitHub Actions, Jenkins, Azure DevOps.
- Databricks Asset Bundles (DABs), Terraform, Docker.
- Production deployment, monitoring, and orchestration experience.
📌 Lead Data Engineer (Bengaluru)
🏢 Quantzig
📍 Bengaluru