21 Nov
|
Recruito
|
Bengaluru
21 Nov
Recruito
Bengaluru
Responsibilities:
Build and maintain real-time and batch data pipelines.
Develop data processing systems to handle large datasets.
Build data ingestion and transformation workflows.
Work with Product, Analytics, and Infrastructure teams to ensure data quality and reliability.
Develop APIs and data models for analytics and machine learning.
Improve database performance, storage, and ETL pipelines.
Requirements:
Experience in Data Engineering.
Robust knowledge of Python; Java or Scala is a plus.
Experience with Kafka, Spark Streaming, or Flink.
Understanding of data modelling, distributed systems, and API integration.
Positive knowledge of SQL, NoSQL, and AWS services like S3, EMR, Redshift, Glue, and Kinesis.
Experience with web scraping tools like Scrapy, Selenium, or Playwright.
Knowledge of ETL pipelines and large-scale data processing.
📌 Senior Data Engineer Bengaluru
🏢 Recruito
📍 Bengaluru