Job Description

Hello,

/n

Job opening at Ai Palette-Bengaluru, please find job details below :-

/n

Job Title – Senior Data Engineer

/n

Experience Level: 5-8 years

/n

Location: Bangalore

/n

Key Responsibilities

/n

/n
- Build and maintain Python-based ETL pipelines and data automation scripts using pandas and numpy
/n
- Write and optimize SQL queries in PostgreSQL, support schema changes, and maintain data integrity
/n
- Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestration
/n
- Build data validation and quality check scripts to ensure pipeline reliability
/n
- Support Elasticsearch index maintenance, data ingestion, and basic mapping updates
/n
- Integrate LLM-generated outputs into structured data pipelines and storage systems
/n
- Write unit tests for data pipelines and instrument code for observability
/n
- Guide junior engineers on data pipeline initiatives
/n
- Collaborate with the product team to design and improve the data layer




/n

/n

Key Qualifications

/n

/n
- 4-8 years of experience in data engineering, backend engineering, or a related technical role
/n
- Python (solid): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformation
/n
- SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basics
/n
- PostgreSQL experience: basic schema understanding, data types, JSONB familiarity is a plus
/n
- Experience building automation scripts for data processing, validation, or reporting
/n
- Familiarity with at least one orchestration tool (Airflow, Prefect, or similar)
/n
- Git, Docker, and standard development workflows
/n
- Writes test cases as part of development
/n

/n

Thanks & Regards,

/n

Salim

/n

(Human Resources)

📌 Senior Data Engineer (Bengaluru)
🏢 GlobalData
📍 Bengaluru