02 Sep
|
GlobalData
|
Mumbai
Hello,
Job opening at Ai Palette-Bengaluru, please find job details below :-
Job Title – Senior Data EngineerExperience Level: 5-8 yearsLocation: Bangalore
Key ResponsibilitiesBuild and maintain Python-based ETL pipelines and data automation scripts using pandas and numpyWrite and optimize SQL queries in PostgreSQL, support schema changes, and maintain data integrityDevelop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestrationBuild data validation and quality check scripts to ensure pipeline reliabilitySupport Elasticsearch index maintenance, data ingestion, and basic mapping updatesIntegrate LLM-generated outputs into structured data pipelines and storage systemsWrite unit tests for data pipelines and instrument code for observabilityGuide junior engineers on data pipeline initiativesCollaborate with the product team to design and improve the data layer
Key Qualifications4-8 years of experience in data engineering, backend engineering, or a related technical rolePython (solid): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformationSQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basicsPostgreSQL experience: basic schema understanding, data types, JSONB familiarity is a plusExperience building automation scripts for data processing, validation, or reportingFamiliarity with at least one orchestration tool (Airflow, Prefect, or similar)Git, Docker, and standard development workflowsWrites test cases as part of development
Thanks & Regards,Salim(Human Resources)
📌 Senior Data Engineer (Mumbai)
🏢 GlobalData
📍 Mumbai