12 Sep
|
GlobalData
|
Karnataka
12 Sep
GlobalData
Karnataka
Job DescriptionHello,
nJob opening at Ai Palette-Bengaluru, please find job details below :-
nJob Title – Senior Data Engineer
nExperience Level: 5-8 years
nLocation: Bangalore
nKey Responsibilities
n
- n
- Build and maintain Python-based ETL pipelines and data automation scripts using pandas and numpyn
- Write and optimize SQL queries in PostgreSQL, support schema changes, and maintain data integrityn
- Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestrationn
- Build data validation and quality check scripts to ensure pipeline reliabilityn
- Support Elasticsearch index maintenance, data ingestion, and basic mapping updatesn
- Integrate LLM-generated outputs into structured data pipelines and storage systemsn
- Write unit tests for data pipelines and instrument code for observabilityn
- Guide junior engineers on data pipeline initiativesn
- Collaborate with the product team to design and improve the data layern
nKey Qualifications
n
- n
- 4-8 years of experience in data engineering, backend engineering, or a related technical rolen
- Python (robust): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformationn
- SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basicsn
- PostgreSQL experience: basic schema understanding, data types, JSONB familiarity is a plusn
- Experience building automation scripts for data processing, validation, or reportingn
- Familiarity with at least one orchestration tool (Airflow, Prefect, or similar)n
- Git, Docker, and standard development workflowsn
- Writes test cases as part of developmentn
nThanks & Regards,
nSalim
n(Human Resources)
📌 Senior Data Engineer (Karnataka)
🏢 GlobalData
📍 Karnataka