About the Role

We are looking for a Senior Data Engineer to build scalable real-time and batch data pipelines for an industrial data platform, processing data from sensors, cameras, APIs, and enterprise systems. The role will support analytics, forecasting, and anomaly detection use cases.

Key Responsibilities

- Design and develop real-time and batch data pipelines.

- Build data processing solutions using Kafka, Spark, and/or Flink.

- Develop workflows using Airflow and/or dbt.

- Design and maintain data lakes, lakehouses, and data warehouses.

- Implement data models for OLAP/OLTP and optimize pipeline performance.

- Deploy solutions across AWS/GCP/Azure or hybrid environments using Docker/Kubernetes.

- Implement data quality, observability, and infrastructure automation.

Required Skills

- 6+ years of Data Engineering experience.





- Strong Python/Java and SQL skills.

- Hands-on experience with Kafka, Spark/Flink, Airflow/dbt.

- Experience with Delta Lake/Iceberg and Snowflake/BigQuery/Redshift.

- Strong knowledge of data modelling and Parquet/Avro/ORC.

- Experience with Cloud, Docker, Kubernetes, Terraform/Ansible.

- Exposure to Great Expectations/OpenMetadata.

Positive to Have

- Experience with InfluxDB/TimescaleDB.

- Exposure to aviation, manufacturing, logistics, or industrial IoT domains.

Pay: ₹400,000.00 - ₹800,000.00 per year

Benefits

- Provident Fund

Work Location: Hybrid remote in Bangalore Corporation Building, Bengaluru, Karnataka

📌 Senior Data Engineer (Bengaluru)
🏢 AVISOFT
📍 Bengaluru