HiLabs builds AI-driven data solutions for US healthcare payers, solving large-scale data quality problems across provider, claims and clinical datasets. Our engineering teams in Pune build the platform that powers this at production scale.
About the Role
We are hiring a Software Engineer II to build scalable, reliable, production-grade backend services for our core data platform. The work spans Python backend engineering, distributed data processing with PySpark, event-driven systems on Kafka and Redis, and ML inference integration — all within a secure AWS environment. You will work closely with Data Science, Data Engineering, DevOps/SecOps and Product teams.
What You Will Do
Design, build and maintain Python backend services and microservices using FastAPI/Flask.
Build scalable PySpark pipelines for ingestion, classification, linkage, feature engineering and schema generation.
Develop event-driven and asynchronous services using Kafka and Redis Streams — producers, consumers, consumer groups, topics, partitioning, offset management and retry handling.
Use Redis for caching,
fast lookups, TTL-based state and distributed coordination.
Build and deploy containerized services on AWS EKS / Kubernetes.
Integrate with AWS S3, EMR, EventBridge, PostgreSQL, Snowflake, Kafka and Redis.
Deploy batch scoring and ML inference services using versioned model artifacts.
Implement reliability patterns: idempotency, retries, timeouts, dead-letter handling and failure recovery.
Design effective database schemas, indexes, queries and data-access layers.
Implement logging, metrics, monitoring and alerting; write unit and integration tests; participate in code reviews.
Troubleshoot across application, data, messaging and infrastructure layers.
Must Have
3–5 years of hands-on backend software engineering experience.
B.E./B.Tech/M.Tech/MCA in Computer Science or a related field from a Tier-1 institute (IIT, NIT, BITS, IIIT or equivalent). This is a mandatory requirement for this posi
📌 Software Engineer II (Pune)
🏢 HiLabs
📍 Pune