Location: India
Experience Required: 6+ Years

About the Role - We are looking for an experienced Data Engineer with over 6 years of experience to design, build, and optimize event-driven architectures for high-throughput, low-latency data flows across distributed systems to deliver business insights.

The ideal candidate has strong expertise in SQL, Python, Snowflake, and hands-on experience with Streaming ETL - any of Flink, Kafka, Spark Streaming

Key Responsibilities:

- Design, develop, and maintain scalable and reliable data pipelines using modern cloud data platforms.
- Architect and implement real-time data streaming pipelines using Apache Kafka / Apache Flink / Spark Streaming
- Design event-driven architectures for high-throughput, low-latency data flows across distributed systems
- Build stateful and stateless Flink jobs for complex event processing, windowed aggregations, and stream joins
- Contribute to data architecture and modeling discussions to enhance data platform scalability and performance.
- Contribute to CI/CD pipeline setup, containerized deployments, and infrastructure-as-code practices

Required Skills:

Mandatory skill set for consideration - Python, SQL, Streaming ETL

• 6+ years of hands-on experience in data engineering, backend engineering, or distributed systems




• Deep understanding of ETL/ELT processes and data warehousing concepts.
• Snowflake: Proficiency in Snowflake data warehouse including architecture, data warehousing, security, and performance optimization will be an added plus
• Proven expertise in Streaming ETL stack - Any one of - Flink / Kafka / Spark streaming across 2 or 3 projects :
• Apache Kafka: production experience with topic design, consumer groups, offset management, Kafka Streams or Kafka Connect
• Apache Flink: experience building streaming jobs, managing checkpoints, windowed computations, and state backends
• Alternatives considered: Apache Spark Structured Streaming, AWS Kinesis, Google Dataflow / Apache Beam
• Good hands-on experience with data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster).
• Experience working with cloud platforms such as AWS, Azure, or GCP.
• Experience in NoSQL DB - MongoDB, Cassandra, DynamoDB will be an added advantage

Soft Skills:
- Solid analytical and problem-solving abilities
- Excellent communication skills with experience working in consulting or client-facing roles
- Strong attention to detail and commitment to data quality

📌 Apache Flink / Apache Kafka / Apache Spark - Data Eng- Azure/AWS (India)
🏢 Factspan Analytics
📍 India