31 Jul
|
KOOE
|
Rajasthan
Job Title: Lead Data Engineer / Technical Lead
Experience: 8+ Years
Location: Remote
Employment Type: Contract
Role Summary
We are seeking an experienced Lead Data Engineer / Technical Lead with robust expertise in Python, SQL, PySpark, Snowflake, Machine Learning, DevOps, CI/CD, Jenkins, AWS, and Azure. The ideal candidate will lead the design and delivery of scalable cloud-native data platforms, mentor engineering teams, and drive architecture, cloud migration, and enterprise data engineering initiatives across AWS and Azure environments.
Key Responsibilities
- Lead the design, development, and deployment of enterprise-scale data platforms and pipelines.
- Architect scalable ETL/ELT solutions using Python, PySpark, SQL, and Snowflake.
- Lead cloud-based data engineering solutions across AWS and Azure.
- Design and optimize data warehouses, lakehouses, and machine learning pipelines.
- Implement and manage DevOps practices, CI/CD pipelines, and deployment automation using Jenkins.
- Collaborate with architects, product teams, and stakeholders to define technical solutions.
- Drive cloud migration, performance optimization, security, and governance initiatives.
- Mentor engineers, conduct code reviews, and establish engineering best practices.
- Ensure high availability, scalability, reliability, and cost optimization of cloud platforms.
- Support production environments and resolve complex technical issues.
Required Skills Experience
- 8+ years of experience in Data Engineering, Cloud Engineering, or Software Development.
- Strong leadership experience managing technical teams and delivering enterprise projects.
- Advanced programming skills in Python and SQL.
- Robust hands-on experience with PySpark and Snowflake.
- Experience building and deploying Machine Learning workflows.
- Hands-on experience with AWS services (S3, EMR, Glue, Lambda, IAM, EC2, Redshift, etc.).
- Hands-on experience with Azure services (Azure Data Factory, Synapse, Databricks, ADLS, Azure Functions, etc.).
- Strong knowledge of DevOps, CI/CD, Jenkins, Git, and deployment automation.
- Experience designing distributed, cloud-native, and high-performance data architectures.
- Excellent communication, stakeholder management, and mentoring skills.
Preferred Skills
- Terraform or Infrastructure as Code.
- Docker and Kubernetes.
- Apache Airflow.
- Kafka or event-driven architectures.
- MLOps and AI platform experience.
Key Competencies
- Technical Leadership
- AWS
- Azure
- Python
- SQL
- PySpark
- Snowflake
- Machine Learning
- DevOps
- CI/CD
- Jenkins
- Cloud Architecture
- Data Engineering
- Team Mentorship
- Performance Optimization
📌 Lead Data Engineer (Rajasthan)
🏢 KOOE
📍 Rajasthan