31 Jul
|
Lifesight
|
Karnataka
31 Jul
Lifesight
Karnataka
About the Role:
We re looking for a Data Engineer with 3 6 years of experience to design, build, and operate large-scale data platforms. You ll develop high-performance batch and streaming pipelines, optimize distributed data processing systems, and contribute to the infrastructure that powers our AI and analytics products.
- Build and maintain scalable batch and streaming data pipelines using Apache Spark and distributed data technologies.
- Design, develop, and optimize ETL workflows with a focus on reliability, performance, and data quality.
- Develop effective SQL queries, data models, and storage solutions across systems such as Bigquery, PostgreSQL, Elasticsearch, DuckDB, and cloud native data platforms.
- Build and maintain workflow orchestration using Airflow (or similar schedulers).
- Monitor, troubleshoot, and optimize production data pipelines to ensure reliability and performance.
- Collaborate with product and engineering teams to design and deliver resilient, production-grade data systems.
- Leverage AI-assisted development tools to improve development speed, code quality, and engineering productivity.
You ll thrive here if you :
- Take ownership and enjoy solving challenging engineering problems.
- Build reliable, scalable, and maintainable software with a strong focus on quality.
- Continuously learn new technologies and improve your engineering skills.
- Communicate effectively and collaborate well across engineering and product teams.
- Enjoy working in a fast-paced setting where your work has a direct impact on customers and the business.
Good to have
- Experience with Kafka, Pub/Sub, or other streaming technologies.
- Experience with Kubernetes, Docker, or infrastructure-as-code tools.
- Exposure to data warehousing technologies such as BigQuery, Snowflake, or Redshift.
- Understanding of CI/CD, observability, and production monitoring for data platforms.
Benefits :
- Early impact Help shape the tech stack and build products from the ground up.
- Agile culture Small teams, zero bureaucracy.
- Outstanding benefits Group Health Insurance, daily breakfast, Friday team lunch, Fun O Clock Fridays, and unlimited coffee, tea snacks.
Required Skills
Apache Spark, AWS, ETL, sql, python, java, Google Cloud Platform (GCP), Linux, airflow
📌 Data Engineer (Karnataka)
🏢 Lifesight
📍 Karnataka