19 Sep
|
Intellias
|
Pune
Job Description
Dear Candidates,
/n
We are hiring for a Senior Data Engineer for our client in India, Remote - US Central Timezone
/n
Exp: 5+ years
/n
Job Location: Remote
/n
Work Mode: Remote
/n
Working Hours: US Central Timezone
/n
Notice Period: Immediate to 30 days Max
/n
Skills Required: Data Engineer, Scala, Python, Kafka, AI, Flink, Spark, Streaming, AWS
/n
Role:
/n
/n
- 5+ years of Data Engineering experience.
/n
- Strong Scala and Apache Spark.
/n
- Experience building and owning production ETL/ELT pipelines.
/n
- Streaming experience with Kafka, Kafka Streams, Flink, or similar.
/n
- Apache Airflow.
/n
- Comfortable with Java, Scala, Python, and configuration-heavy code.
/n
- Strong data modeling, schema design, and source-to-target mapping.
/n
- Data quality, validation, and production troubleshooting.
/n
- Strong software engineering practices (testing, CI/CD, versioning).
/n
- Ability to review AI-generated code.
/n
/n
Solid nice-to-have
/n
/n
- Flink expertise.
/n
- ScyllaDB, Cassandra, DynamoDB, or other NoSQL platforms.
/n
- Customer Data Platform (CDP), identity resolution, loyalty, clickstream, or booking data experience.
/n
- Experience with SLAs, SLOs, observability, and monitoring.
/n
- GitHub Copilot, Claude, Cursor, or similar AI-assisted development tools
/n
/n
Responsibilities:
/n
/n
- Design, build, and optimize batch and streaming data pipelines using Scala and Spark.
/n
- Develop and support Kafka/Flink-based streaming solutions.
/n
- Build and maintain Airflow DAGs, backfills, and production workflows.
/n
- Design data models, schemas, and source-to-target mappings.
/n
- Implement data quality controls, validation, and monitoring.
/n
- Troubleshoot production issues and ensure platform reliability.
/n
- Review and validate AI-generated code and maintain engineering quality standards.
/n
- Own systems end-to-end, including performance, cost, scalability, and reliability.
/n
/n
If you find above job descriptio
📌 Senior Data Engineer (Pune)
🏢 Intellias
📍 Pune