10 Sep
|
YMinds.AI
|
Bengaluru
10 Sep
YMinds.AI
Bengaluru
Our client is looking for an experienced Data Engineer with 3–5 years of hands-on Data Engineering experience.
The ideal candidate should have strong experience in Python, PySpark, and SQL, along with exposure to modern cloud and data platforms such as AWS, Azure, GCP, Snowflake, or Databricks.
Candidates do not need to have experience across all cloud platforms or technologies. Strong hands-on Data Engineering experience with Python, PySpark, SQL, ETL/ELT, and scalable data pipelines is the primary requirement.
Exposure to Generative AI, Large Language Models (LLMs), RAG, AI Agents, or AI-enabled data solutions is preferred but not mandatory for candidates with a strong Data Engineering background.
Key Responsibilities
Design, develop, and maintain scalable and reliable data pipelines using Python, PySpark, SQL, and modern data engineering platforms.
Develop and optimize ETL/ELT workflows for batch and/or real-time data processing.
Write and optimize complex SQL queries for data transformation, integration, and analytics.
Build data solutions using one or more cloud platforms such as AWS, Azure, or GCP.
Work with modern data platforms such as Snowflake, Databricks, Spark, or similar technologies.
Process and transform large-scale structured and unstructured datasets.
Troubleshoot and optimize pipelines for performance, scalability, reliability, and cost efficiency.
Integrate data from multiple sources, APIs, databases, files, and cloud storage platforms.
Support data quality, monitoring, production troubleshooting, and data validation.
Where applicable, contribute to GenAI/LLM-enabled data engineering solutions.
Collaborate with engineering, analytics, AI/ML, product, and business teams in Agile and/or Waterfall environments.
Required Skills
3–5 years of hands-on Data Engineering experience.
Solid hands-on experience with Python.
Strong hands-on experience with PySpark / Apache Spark.
Strong practical knowledge of SQL, including complex queries, joins, transform
📌 Data Engineer | 3-5 Years (Bengaluru)
🏢 YMinds.AI
📍 Bengaluru