19 Sep
|
Intellias
|
Pune
Dear Candidates,
We are hiring for a Senior Data Engineer for our client in India, Remote - US Central Timezone
Exp: 5+ years
Job Location: Remote
Work Mode: Remote
Working Hours: US Central Timezone
Notice Period: Immediate to 30 days Max
Skills Required: Data Engineer, Scala, Python, Kafka, AI, Flink, Spark, Streaming, AWS
Role:
5+ years of Data Engineering experience.
Strong Scala and Apache Spark.
Experience building and owning production ETL/ELT pipelines.
Streaming experience with Kafka, Kafka Streams, Flink, or similar.
Apache Airflow.
Comfortable with Java, Scala, Python, and configuration-heavy code.
Strong data modeling, schema design, and source-to-target mapping.
Data quality, validation, and production troubleshooting.
Robust software engineering practices (testing, CI/CD, versioning).
Ability to review AI-generated code.
Strong nice-to-have
Flink expertise.
ScyllaDB, Cassandra, DynamoDB, or other NoSQL platforms.
Customer Data Platform (CDP), identity resolution, loyalty, clickstream,
or booking data experience.
Experience with SLAs, SLOs, observability, and monitoring.
GitHub Copilot, Claude, Cursor, or similar AI-assisted development tools
Responsibilities:
Design, build, and optimize batch and streaming data pipelines using Scala and Spark.
Develop and support Kafka/Flink-based streaming solutions.
Build and maintain Airflow DAGs, backfills, and production workflows.
Design data models, schemas, and source-to-target mappings.
Implement data quality controls, validation, and monitoring.
Troubleshoot production issues and ensure platform reliability.
Review and validate AI-generated code and maintain engineering quality standards.
Own systems end-to-end, including performance, cost, scalability, and reliability.
If you find above job description relevant to your profile then do DM me or forward me your resume on
Regards,
Ankita
📌 Senior Data Engineer (Scala) (Pune)
🏢 Intellias
📍 Pune