16 Sep
|
Soul AI
|
Bengaluru
Whats in it for you?
Pay above market standards The role is going to be contract based with project timelines from 2 12 months, or freelancing
Be a part of an Elite Community of professionals who can solve complex AI challenges
Work location could be
Remote (Highly likely)
Onsite on client location
Deccan AIs Office: Hyderabad or Bangalore
Responsibilities
Design and architect enterprise-scale data platforms, integrating diverse data sources and tools
Develop real-time and batch data pipelines to support analytics and machine learning
Define and enforce data governance strategies to ensure security, integrity, and compliance along with optimizing data pipelines for high performance, scalability, and cost efficiency in cloud environments
Implement solutions for real-time streaming data (Kafka, AWS Kinesis, Apache Flink) and adopt DevOps/DataOps best practices
Required Skills
Robust experience in designing scalable, distributed data systems and programming (Python, Scala, Java) with expertise in Apache Spark, Hadoop, Flink, Kafka, and cloud platforms (AWS, Azure, GCP)
Proficient in data modeling, governance, warehousing (Snowflake, Redshift, BigQuery), and security/compliance standards (GDPR, HIPAA)
Hands-on experience with CI/CD (Terraform, Cloud Formation, Airflow, Kubernetes) and data infrastructure optimization (Prometheus, Grafana)
Nice to Have
Experience with graph databases, machine learning pipeline integration, real-time analytics, and IoT solutions
Contributions to open-source data engineering communities
What are the next steps?
Register on our Soul AI website
📌 Data Engineer (Bengaluru)
🏢 Soul AI
📍 Bengaluru