Hello,

Job opening at Ai Palette-Bengaluru, please find job details below :-

Job Title – Senior Data Engineer

Experience Level: 5-8 years

Location: Bangalore

Key Responsibilities

Build and maintain Python-based ETL pipelines and data automation scripts using pandas and numpy

Write and optimize SQL queries in Postgre SQL, support schema changes, and maintain data integrity

Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestration

Build data validation and quality check scripts to ensure pipeline reliability

Support Elasticsearch index maintenance, data ingestion, and basic mapping updates

Integrate LLM-generated outputs into structured data pipelines and storage systems

Write unit tests for data pipelines and instrument code for observability

Guide junior engineers on data pipeline initiatives

Collaborate with the product team to design and improve the data layer

Key Qualifications





4-8 years of experience in data engineering, backend engineering, or a related technical role

Python (solid): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformation

SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basics

Postgre SQL experience: basic schema understanding, data types, JSONB familiarity is a plus

Experience building automation scripts for data processing, validation, or reporting

Familiarity with at least one orchestration tool (Airflow, Prefect, or similar)

Git, Docker, and standard development workflows

Writes test cases as part of development

Thanks & Regards,

Salim

(Human Resources)

📌 Senior Data Engineer (Bengaluru)
🏢 GlobalData
📍 Bengaluru