16 Sep
|
Soul AI
|
Mumbai
- We are lookingWe are looking for top-tier Data Engineers who are proficient in designing, building and optimizing data pipelines.
- If you have experience in this field then this is your chance to collaborate with industry leaders.
Whats in it for you.
- Pay above market standards.
- The role is going to be contract based with project timelines from 2 12 months, or freelancing.
- Be a part of an Elite Community of professionals who can solve complex AI challenges.
- Work location could be
- Remote (Highly likely).
- Onsite on client location.
- Deccan AIs OfficeHyderabad or Bangalore.
Responsibilities
- Design and architect enterprise-scale data platforms, integrating diverse data sources and tools.
- Develop real-time and batch data pipelines to support analytics and machine learning.
- Define and enforce data governance strategies to ensure security, integrity, and compliance along with optimizing data pipelines for high performance, scalability, and cost efficiency in cloud environments.
- Implement solutions for real-time streaming data (Kafka, AWS Kinesis, Apache Flink ) and adopt DevOps/ DataOps best practices.
Required Skills:
- Solid experience in designing scalable, distributed data systems and programming (Python, Scala, Java) with expertise in Apache Spark, Hadoop, Flink , Kafka, and cloud platforms (AWS, Azure, GCP).
- Proficient in data modeling, governance, warehousing (Snowflake, Redshift, BigQuery ), and security/compliance standards (GDPR, HIPAA).
- Hands-on experience with CI/CD (Terraform, Cloud Formation, Airflow, Kubernetes) and data infrastructure optimization (Prometheus, Grafana).
Nice to Have
- Experience with graph databases, machine learning pipeline integration, real-time analytics, and IoT solutions.
- Contributions to open-source data engineering communities.
- What are the next steps.
- Register on our Soul AI website.
- Our team will review your profile.
- Clear all the screening roundsClear the assessments once you are shortlisted.
- Profile matching and Project AllocationBe patient while we align your skills and preferences with the available project.
- Skip the Noise.
- Focus on Opportunities Built for You!.
📌 Data Engineer (Freelancer) (Mumbai)
🏢 Soul AI
📍 Mumbai