The Enterprise Data Engineer will be a member of the Global Cybersecurity Data Acquisition and Engineering team responsible for all aspects of data acquisition and onboarding to the cyber data lake and analytics platform The team partners with IT Infrastructure teams in endtoend deployment of security technologies across the firm and delivers normalised security data feeds to the Databricks cyber analytics platform
The role involves the design and implementation of data ingestion patterns and pipelines to make feeds available for security analytics It requires sustainable reliable and performant solutions to be implemented on a repeatable basis
The role requires an experienced systems engineer with robust technical leadership and collaboration skills The ideal candidate will have significant experience in data pipeline and analytics technologies Linux system administration and cloud infrastructure eg Databricks Data Factory NiFi Kafka RHELUbuntu Azure Function Apps Azure platform services etc
Responsibilities will include But not limited to
Engineering leadership and support for existing and future data analytics technology Databricks Data Factory NiFi Kafka Fluentd etc
Leading the continued technical enhancement of security platforms
Supporting the identification development and implementation of new detections and analytics use cases
Leading the continued evolution of automation and orchestration across the platform
Training and developing other members of the cyber analytics team as well as other members of the engineering function
Supporting a culture of individual selfimprovement whereby staff are expected to maintain subject matter expertise within their area of focus and within the realm of cybersecurity more broadly for example remaining up to date on the tooling for strategically important platforms
Taking a leading role in the engagement of Global Businesses and Functions