Data Engineer / Analyst Job Description
Experience Level: 5-7 Years

About the Role
We are looking for a versatile Data Engineer & Analyst who can bridge the gap between robust data infrastructure and actionable business insights. The ideal candidate will design and maintain scalable data pipelines while also delivering meaningful analytics and dashboards to drive decision-making. This role requires robust hands-on expertise in modern data engineering tools combined with a working knowledge of AI/ML concepts and their practical application in data workflows.

Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines using Apache Airflow for orchestration and workflow automation
Develop and optimize data models and warehousing solutions in Snowflake
Write efficient, production-grade SQL queries for data transformation, validation, and reporting
Build data processing and automation scripts using Python
Leverage Databricks for large-scale data processing, transformation, and advanced analytics workloads
Design and develop interactive dashboards and reports using Power BI to support business stakeholders
Collaborate with cross-functional teams (business, product, and engineering) to gather requirements and translate them into data solutions
Ensure data quality, integrity, and governance across pipelines and reporting layers
Identify opportunities to apply AI/ML techniques (e.g., predictive modeling, anomaly detection, NLP-based automation) to improve data processes or generate business insights
Implement basic AI-driven solutions or proof-of-concepts (e.g., using LLMs, forecasting models, or classification models) and integrate them into existing data workflows
Monitor pipeline performance, troubleshoot issues, and optimize for cost and efficiency
Document technical processes, data flows, and architecture for team knowledge sharing

Required Skills & Experience





- 5-7 years of experience in data engineering, data analytics, or a related field
- Strong hands-on experience with Apache Airflow for pipeline orchestration
- Proficiency in Snowflake (data modeling, performance tuning, warehouse management)
- Advanced SQL skills (complex queries, optimization, stored procedures)
- Robust programming skills in Python (data manipulation, automation, libraries like Pandas/PySpark)
- Experience with Databricks for big data processing and analytics
- Proficiency in Power BI (DAX, data modeling, dashboard design, report publishing)
- Practical exposure to AI/ML concepts with at least one proven implementation (e.g., a deployed model, automated AI-driven workflow, or use of LLMs/APIs in a business context)
- Hands-on experience with dimensional data modeling (star schema, snowflake schema, fact/dimension tables)
- Solid understanding of OLTP and OLAP systems and the ability to design solutions appropriate to each
- Solid understanding of data warehousing concepts, ETL/ELT design patterns, and cloud data architecture
- Familiarity with AWS (e.g., S3, Glue, Redshift, Lambda, or similar data-related services)

Preferred Qualifications
Prior experience in the semiconductor industry, working with domain-specific data such as fab/manufacturing data, yield analysis, wafer testing, supply chain, or product engineering datasets
Experience with version control (Git) and CI/CD for data pipelines
Familiarity with data governance, security, and compliance best practices
Exposure to MLOps or LLM integration frameworks (e.g., LangChain, OpenAI/Anthropic APIs)
Strong problem-solving skills and ability to work independently in a fast-paced environment
Excellent communication skills to translate technical concepts for non-technical stakeholders

Education
~ Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field (or equivalent practical experience)

📌 Data Engineer - ML & AI (Bengaluru)
🏢 TRUGlobal
📍 Bengaluru