01 Aug
|
Skyleaf Consultants
|
Bengaluru
01 Aug
Skyleaf Consultants
Bengaluru
Passionate Gamers Building Unique Experiences
Highlights:
3.00 - 5.00 Years
40.00 - 45.00 INR (Lacs)/Yearly
Full time
Bangalore
Roles & Responsibility
Key Responsibilities:
- Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data.
- Enhancing infrastructure for scalability, automation, and data delivery improvements.
- Developing real-time and batch processing solutions using Kafka, Spark, and Airflow.
- Ensuring data governance, security compliance, and high availability.
- Collaborating with product, business, and analytics teams to support data needs.
Tech Stack:
-
Big Data Tools: Spark, Kafka, Databricks (Delta Tables), ScyllaDB, Redshift
- Data Pipelines & Workflow: Airflow, EMR, Glue, Athena
- Programming: Java, Scala, Python
- Cloud & Storage: AWS
- Databases: SQL, NoSQL (ScyllaDB, OpenSearch)
- Backend: Spring Boo
Requirements
Key Responsibilities:
- Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data.
- Enhancing infrastructure for scalability, automation, and data delivery improvements.
- Developing real-time and batch processing solutions using Kafka, Spark, and Airflow.
- Ensuring data governance, security compliance, and high availability.
- Collaborating with product, business, and analytics teams to support data needs.
Tech Stack:
-
Big Data Tools: Spark, Kafka, Databricks (Delta Tables), ScyllaDB, Redshift
- Data Pipelines & Workflow: Airflow, EMR, Glue, Athena
- Programming: Java, Scala, Python
- Cloud & Storage: AWS
- Databases: SQL, NoSQL (ScyllaDB, OpenSearch)
- Backend: Spring Boo
📌 Senior Data Engineer Passionate gamers building unique experiences (Bengaluru)
🏢 Skyleaf Consultants
📍 Bengaluru