16 Oct
|
techvantage.ai
|
Kerala
16 Oct
techvantage.ai
Kerala
We are looking for a Senior/Lead Data Engineer to build scalable batch and real-time data pipelines, develop robust data platforms, and leverage GenAI to automate and optimize data engineering workflows.
Must-Have Skills5–10 years of experience in Data Engineering, including 2+ years in a senior/lead role. Strong proficiency in SQL, Python, Shell scripting, and Scala/PySpark.
Hands-on experience with ETL/ELT pipelines, data modelling, and data warehousing. Experience with AWS services such as S3, Redshift, Glue, Kinesis, Lambda, and EC2. Experience with Git/GitHub, CI/CD, and production data platforms.
Practical experience using GenAI/LLM tools to automate or accelerate engineering tasks.
Good-to-Have SkillsExperience with LangChain, LlamaIndex,
RAG pipelines, and AI agents. Familiarity with Airflow, dbt, Docker, and Kubernetes.
Exposure to Azure or GCP.
Knowledge of AI governance, data security, and quality guardrails.
Strong technical leadership, stakeholder management, and problem-solving skills.
What We OfferOpportunity to build AI-augmented data platforms and scalable data solutions. Work with GenAI technologies in a fast-paced, cutting-edge environment.
Collaborate with exceptional talent and contribute directly to business growth.
📌 Senior Data Engineer(5+ years) (Kerala)
🏢 techvantage.ai
📍 Kerala