21 Nov
|
Insight Global
|
India
21 Nov
Insight Global
India
Data Engineer
Location: India
Employment Type: Contract
Work Model: REMOTE
Start Date: Immediately - 12/14
Pay Rate: Approximately 2,220-2,315 per hour*
About the Role
We are seeking an experienced Data Engineer to design, build, and support scalable data pipelines and data warehouse solutions. The role is heavily focused on real-time data engineering, including ingesting, transforming, modeling, and validating data from multiple source systems.
The ideal candidate will have strong experience building production-grade, real-time data pipelines, advanced SQL skills, and hands-on experience with modern cloud data technologies such as Kafka, Airflow, BigQuery, dbt, and Google Cloud Platform (GCP).
This role also supports reporting and analytics use cases, but the team's primary need is solid data engineering capability. Candidates who also understand business metrics and analytics will be especially valuable.
Responsibilities
- Design, build, test, deploy, and maintain real-time and batch data pipelines.
- Build reliable, fault-tolerant, low-latency solutions that move data from source systems into the data warehouse.
- Develop scalable data models supporting analytics, reporting, and customer-facing applications.
- Write and optimize advanced SQL queries for large datasets and production environments.
- Work with Kafka, Airflow, BigQuery, dbt, GCP, and related data technologies.
- Integrate structured and unstructured data from multiple sources, including NoSQL environments such as MongoDB.
- Validate data quality, accuracy, completeness, and reliability throughout the data pipeline.
- Translate business requirements and metrics into effective data models and datasets.
- Partner with analytics and product teams to support customer-facing reporting and drill-down functionality.
- Implement appropriate row-level and column-level security controls.
- Support reporting environments using Looker, Redash, and internally developed tools.
- Follow applicable data privacy, security, and compliance practices.
Required Qualifications
- Approximately 6+ years of professional data engineering experience, or an equivalent combination of relevant education and experience.
- Demonstrated experience designing and developing production-grade data pipelines.
- Strong understanding of data modeling, database design, data warehousing, and data transformation.
- Hands-on experience designing and developing real-time or streaming data pipelines.
- Experience moving data from source systems through transformation layers into downstream data stores.
- Understanding of latency, scalability, fault tolerance, and data quality within production pipelines.
- Advanced SQL skills, including writing complex and performant queries.
- Hands-on experience with several of the following:
-Kafka
-Airflow
-BigQuery
-dbt
-Google Cloud Platform (GCP)
-MongoDB or comparable NoSQL technologies
Preferred Qualifications
- Experience working within GCP.
- Experience with MongoDB or another NoSQL database.
- Experience with Kubernetes.
- Experience supporting analytics alongside core data engineering responsibilities.
- Experience with Looker, Redash, or similar BI and dashboarding platforms.
- Experience writing code in Python, JavaScript, or R.
- Experience working with clinical trial, healthcare, life sciences, or other highly regulated data.
- Familiarity with data privacy and compliance requirements such as HIPAA and GDPR.
📌 Data Engineer (India)
🏢 Insight Global
📍 India