Company Description AGNOW Solutions is a ServiceNow consulting and Agentic AI solutions company that helps enterprises accelerate digital transformation through intelligent automation, workflow optimization, and responsible AI adoption. The team’s expertise spans ServiceNow modules such as ITSM, HRSD, ITOM, AIOps, IRM, Strategic Portfolio Management (SPM), as well as ServiceNow Otto, AI Control Tower, Moogsoft AIOps, AI agents, and enterprise AI governance. Using its proprietary AGRIM Framework™, AGNOW Solutions supports organizations in modernizing operations, improving service delivery, strengthening governance, and achieving measurable business outcomes. The company operates with India-delivered capabilities and a globally proven track record, focusing on intelligent enterprise transformation for customers worldwide. Role Overview We are seeking an experienced Data Engineer to design, build, and optimize scalable data ingestion pipelines for product telemetry and enterprise business applications data. This role operates in a fast‑paced environment, rapidly prototyping data pipelines to enable data exploration, analytics, and downstream consumption. Responsibilities
• Design and implement modern data ingestion pipelines for business systems data using:
• Fivetran or Similar tool
• Python and Bulk APIs
• Object storage and S3‑based lakehouse architectures
• Streaming ingestion techniques leveraging Kafka, Spark, and other open‑source frameworks
• Build end‑to‑end automated pipelines from source systems to Snowflake, ensuring reliability, scalability, and observability.
• Apply data curation techniques (advanced SQL) in Snowflake, including transformation, standardization, and preparation of analytics‑ready datasets.
• Optimize ingestion performance for large‑scale,



high‑volume datasets (terabytes of data) using:
• API rate‑limit handling
• Micro‑batching strategies
• Incremental loading and CDC (Change Data Capture) techniques
• Implement DevOps and CI/CD practices for data pipelines, including version control, deployment automation, and setting management.
• Partner with data analysts, SMEs, and platform teams to quickly prototype data pipelines supporting exploration and evolving requirements.
• Monitor, troubleshoot, and optimize ingestion jobs to ensure data freshness, accuracy, and performance. Required Skills & Experience
• 6+ years of strong hands‑on experience in data engineering and ingestion automation in cloud or hybrid environments.
• Proven experience ingesting business application data (e.g., CRM, ERP, financial, consumption, renewals systems).
• Advanced proficiency with Python, Fivetran (or Similar ETL/ELT tool) for building ingestion pipelines, automation, orchestration, and data validation.
• Expertise with streaming and distributed data processing technologies such as Kafka and Spark. Experience working with S3 or lakehouse‑style storage architectures.
• Strong proficiency with Snowflake, including data ingestion, transformation, and performance optimization.
• Deep understanding of ingestion optimization techniques for large, voluminous datasets, including rate limits, micro‑batching, incremental loads, and CDC.
• Experience applying DevOps practices to data pipelines, including CI/CD and operational automation.
• Ability to work independently in a fast‑paced, iterative environment and deliver working solutions rapidly. Desirable Skills
• Experience with additional open‑source ingestion frameworks and connectors
• Exposure to event‑driven or telemetry‑heavy architectures at scale

📌 Senior Data Engineer – Data Ingestion (India)
🏢 AGNOW Solutions
📍 India