19 Aug
|
YMinds.AI
|
Bengaluru
19 Aug
YMinds.AI
Bengaluru
Our client is seeking a Data Engineer with 4–8 years of experience in designing and developing scalable data solutions. The ideal candidate will have strong hands-on expertise in Python, PySpark, SQL, and AWS, along with practical experience in Generative AI and Large Language Models (LLMs).
This role requires a solid understanding of data engineering concepts, cloud-based data platforms, and up-to-date data-processing workflows. The candidate should be comfortable working across Agile and Waterfall environments while collaborating effectively with technical and business stakeholders.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and data-processing workflows.
Build data engineering solutions using Python, PySpark, and SQL.
Develop and optimize SQL scripts for data transformation, validation, and analysis.
Process and manage large volumes of structured and unstructured data.
Design and implement cloud-based data solutions, preferably on AWS.
Integrate data pipelines with Generative AI and LLM-based applications.
Ensure data quality, reliability, performance,
and scalability across data workflows.
Troubleshoot data pipeline issues and optimize processing performance.
Collaborate with AI, engineering, product, and business teams to understand data requirements.
Document data pipelines, technical designs, and operational processes.
Required Skills
4–8 years of hands-on experience in Data Engineering.
Strong hands-on experience with Python and PySpark.
Strong knowledge and practical experience in SQL scripting.
Solid understanding and hands-on experience with core data engineering concepts.
Exposure with Generative AI and Large Language Models (LLMs) is a plus.
Strong hands-on experience with a cloud platform, preferably AWS.
Excellent communication, collaboration, and interpersonal skills
Nice-to-Have Skills
Exposure to AWS data services such as S3, Glue, EMR, Redshift, Lambda, or Athena.
Knowledge of data lakes, data warehouses, and distr
📌 Data Engineer | 4–8 Years | Upto 24LPA |Bengaluru | Immediate Joiners Only
🏢 YMinds.AI
📍 Bengaluru