Experience: 2 to 3 years

Location: Chennai / Bangalore

Job purpose:

Support the design, configuration, and operation of Qlik Replicate tasks to enable reliable Full Load + CDC replication from enterprise sources to modern analytics platforms. Work closely with senior consultants to onboard endpoints, configure tasks, monitor latency and throughput, and document runbooks. Participate in requirement discussions, adhere to governance/security practices, and contribute to cost-aware, scalable data movement.

Duties and responsibilities of position:

General areas of responsibility relate to:

Assist in client requirements workshops; translate replication needs into task configurations and endpoint mappings.

Set up secure, scalable replication from common source systems to analytics targets (cloud/on-prem).

Maintain compliance and governance (access controls, audit logs, encryption in transit/at rest).

Prepare basic solution artifacts: endpoint inventories, task design notes, data flow diagrams, and runbooks.

Support production reliability through monitoring, basic troubleshooting, and reporting on SLAs (latency, freshness).

Collaborate with cross-functional teams (DBAs, Cloud Ops, BI, Data Engineering)

Specific areas of responsibility include but are not limited to:

Configure source endpoints (e.g., Oracle, SQL Server, MySQL, PostgreSQL, SAP—if licensed) including drivers, privileges, and supplemental logging where required.

Configure target endpoints (e.g., Snowflake, Azure Synapse, Databricks/Delta, S3/Blob, Kafka, Azure SQL) with appropriate credentials, network policies, and SSL/TLS settings.

Validate connectivity, test schemas/tables, and define table selection and filters.

Create Replication Tasks (Full Load CDC) with table selection, key identification, and LOB handling.





Implement CDC using change tables/redo logs/native mechanisms; configure apply modes (batch size, commit rate, parallel apply) under guidance.

Handle mappings/transform options (basic column transformations, data type mappings) and error handling routes (apply conflicts, retry/backoff).

Monitor task latency, throughput, and bottlenecks using Replicate Console metrics.

Apply basic tuning with senior guidance (e.g., parallel apply, cache settings, fetch sizes, partitioning strategies).

Work with DBAs to validate source readiness (indexes, logging, archive/redo management; replication slots for PostgreSQL).

Set up alerts/notifications for task failures, latency thresholds, or endpoint connectivity issues.

Maintain runbooks: start/stop procedures, restart semantics, bookmark management, and fallback (resume/reinitialize).

Document cutover steps and post-load validation (row counts, checksums, sample comparisons).

Enforce least privilege access, rotate credentials securely, and store secrets per enterprise policy.

Ensure encryption (in transit/at rest) and maintain audit trails (task changes, promotions, access).

Tag and catalog replicated datasets; record data ownership and PII classifications (if applicable).

Version control task exports/configs (JSON/XML) and endpoint definitions in Git; follow branching and review practices.

Assist in environment promotions (dev test prod) and maintain release notes.





Support CI/CD pipelines that deploy Replicate tasks (where applicable via scripts/APIs).

Participate in POCs for new sources/targets (e.g., Oracle Snowflake, SQL Server Synapse, PostgreSQL Kafka).

Contribute to solution decks (assumptions, constraints, risks) and basic effort estimates.

Document decisions, issues, and actions; communicate progress in stand-ups or status calls.

Qualifications:

Bachelor’s degree in Computer Science, Information Technology, or a related field; or equivalent professional experience.

Experience: 2–3 years in data engineering/integration with at least 1–2 years exposure to Qlik Replicate (or similar CDC tools).

Qlik Replicate: endpoints, task setup, Full Load + CDC, table selection, basic mappings/transform options, task monitoring, error handling.

Databases: Oracle/SQL Server/MySQL/PostgreSQL fundamentals; supplemental logging, keys/PKs, redo/archive logs, replication slots (PostgreSQL).

Targets: Snowflake/Synapse/Databricks/Kafka/S3/Blob (any mix) connectivity and configuration basics.

SQL (Basic): joins, filters, aggregations; post-load validation queries; row count reconciliation.

Scripting (Basic): Python or PowerShell/Bash for utilities (exports, health checks, notifications).

Networking & Security: SSL/TLS, firewalls, VNET/VPC basics; least privilege; secrets handling.

Version Control/DevOps: Git, setting promotion concepts; CI/CD familiarity (Azure DevOps/GitHub Actions).

Proficiency in SQL, Python for data processing and transformations.

Hands-on experience in data modeling, indexing, and query performance tuning.

Experience with Microsoft 365 administration (e.g., Exchange, SharePoint, OneDrive, Teams).

Experience with backup, disaster recovery, and business continuity planning.

📌 Associate Consultant (Qlik Replicate) (India)
🏢 GainInsights
📍 India