The Enterprise Data Engineer will be part of the Global Cybersecurity Data Acquisition and Engineering team , responsible for data acquisition, onboarding and engineering of security data into the cyber data lake and analytics platform.
The role involves designing and implementing reliable, scalable and performant data ingestion pipelines to support security analytics and cybersecurity use cases.
Key Responsibilities:
- Design, develop and maintain data ingestion pipelines for cybersecurity data.
- Work with Databricks, Azure Data Factory, PySpark, NiFi, Kafka and Fluentd .
- Develop scalable and reliable data pipelines for large datasets.
- Support data acquisition, onboarding, transformation and normalization.
- Drive automation and optimization of data engineering pipelines.
- Support real-time analytics and streaming data processing.
- Collaborate with Cybersecurity,
Infrastructure and IT teams to develop data solutions.
- Contribute to recent detection and analytics use cases.
- Support automation, orchestration and platform improvements.
- Work with cloud infrastructure and Azure platform services.
- Provide technical guidance and support to other engineering team members.
- Contribute to continuous improvement of cybersecurity data platforms.
Required Skills:
- Azure Data Factory
- Databricks
- PySpark
- Cloud-based data pipelines
- Data ingestion, transport and transformation
- Azure cloud services
- Linux / RHEL / Ubuntu
- Kafka / Azure Event Hubs
- Spark Streaming
- Data engineering automation and optimization
Good to Have:
- NiFi / Fluentd
- Terraform, Chef or Ansible
- Azure Functions
- SIEM / SOAR technologies
- Cybersecurity data engineering experience
- Azure / Databricks certifications
📌 Enterprise Data Engineer (Hyderabad)
🏢 CSbusinesmgmt.in
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.