Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
Build and optimize data solutions using Databricks on AWS Cloud.
Develop and manage data ingestion, transformation, and integration processes for structured and unstructured data.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
Optimize data processing jobs for performance, scalability, and cost efficiency.
Implement data quality checks, monitoring, troubleshooting, and performance tuning.
Utilize GitHub Copilot and AI coding assistants to improve development productivity and code quality.
Leverage Claude and GPT/LLM technologies to support data engineering use cases, automation, and intelligent workflows.
Follow DevOps and CI/CD best practices for deployment and maintenance of data pipelines.
Ensure adherence to data governance, security, and cloud best practices.

Mandatory Skills




36 years of hands-on experience in Data Engineering.
Strong experience with Databricks.
Hands-on experience with AWS Cloud services.
Solid proficiency in Python and SQL.
Experience in designing and building scalable data pipelines.
Hands-on experience with GitHub Copilot.
Working knowledge of Claude AI, GPT, or other Large Language Models (LLMs) and their practical applications.
Good understanding of distributed data processing frameworks and up-to-date data architectures.
Experience with version control systems such as Git.

Preferred Candidate Profile
Hands-on experience in developing data pipelines on cloud platforms.
Familiarity with AI-assisted development tools and LLM-powered workflows.
Robust analytical and problem-solving skills.
Excellent communication and stakeholder management skills.

📌 Data Engineer Gurugram
🏢 Infinites Hr Services Pune
📍 Gurugram