21 Aug
|
YMinds.AI
|
Bengaluru
21 Aug
YMinds.AI
Bengaluru
Our client is seeking a
Data Engineer
with 4
–8 years of experience
in designing and developing scalable data solutions. The ideal candidate will have strong hands-on expertise in
Python, PySpark, SQL, and AWS
, along with practical experience in
Generative AI and Large Language Models (LLMs)
.
This role requires a solid understanding of data engineering concepts, cloud-based data platforms, and modern data-processing workflows. The candidate should be comfortable working across Agile and Waterfall environments while collaborating effectively with technical and business stakeholders.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data-processing workflows.
- Build data engineering solutions using
Python, PySpark, and SQL
.
- Develop and optimize SQL scripts for data transformation, validation, and analysis.
- Process and manage large volumes of structured and unstructured data.
- Design and implement cloud-based data solutions, preferably on
AWS
.
- Integrate data pipelines with
Generative AI and LLM-based applications
.
- Ensure data quality,
reliability, performance, and scalability across data workflows.
- Troubleshoot data pipeline issues and optimize processing performance.
- Collaborate with AI, engineering, product, and business teams to understand data requirements.
- Document data pipelines, technical designs, and operational processes.
Required Skills
- 4–8 years of hands-on experience in Data Engineering.
- Strong hands-on experience with
Python and PySpark
.
- Strong knowledge and practical experience in
SQL scripting
.
- Solid understanding and hands-on experience with core
data engineering concepts
.
- Exposure with
Generative AI and Large Language Models (LLMs) is a plus.
- Solid hands-on experience with a cloud platform, preferably
AWS
.
- Excellent communication, collaboration, and interpersonal skills
Nice-to-Have Skills
- Exposure to AWS data services such as
S3, Glue, EMR, Redshift, Lambda, or Athena
.
- Kno
📌 Data Engineer | 4–8 Years | Upto 24LPA |Bengaluru | Immediate Joiners Only
🏢 YMinds.AI
📍 Bengaluru