12 Sep
|
GlobalData
|
Bengaluru
12 Sep
GlobalData
Bengaluru
Job DescriptionHello,
NJob opening at Ai Palette-Bengaluru, please find job details below :-
NJob Title – Senior Data Engineer
NExperience Level: 5-8 years
NLocation: Bangalore
NKey Responsibilities
n
N
- Build and maintain Python-based ETL pipelines and data automation scripts using pandas and numpy
N
- Write and optimize SQL queries in PostgreSQL, support schema changes, and maintain data integrity
N
- Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestration
N
- Build data validation and quality check scripts to ensure pipeline reliability
N
- Support Elasticsearch index maintenance, data ingestion, and basic mapping updates
N
- Integrate LLM-generatedoutputs into structured data pipelines and storage systems
N
- Write unit tests for data pipelines and instrument code for observability
N
- Guide junior engineers on data pipeline initiatives
N
- Collaborate with the product team to design and improve the data layer
N
nKey Qualifications
N
n
- 4-8 years of experience in data engineering, backend engineering, or a related technical role
N
- Python (robust): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformation
N
- SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basics
N
- PostgreSQL experience: basic schema understanding, data types, JSONB familiarity is a plus
N
- Experience building automation scripts for data processing, validation, or reporting
N
- Familiarity with at least one orchestration tool (Airflow, Prefect, or similar)
N
- Git, Docker, and standard development workflows
N
- Writes test cases as part of development
N
nThanks & Regards,
NSalim
n(Human Resources)
📌 Hiring: Senior Data Engineer (Bengaluru)
🏢 GlobalData
📍 Bengaluru