01 Aug
|
Chicago Mercantile Exchange
|
Bengaluru
01 Aug
Chicago Mercantile Exchange
Bengaluru
The core responsibilities focus on the reliability, automation, and performance of data systems on the Google Cloud Platform (GCP):
Infrastructure & Automation: Design, build, secure, and maintain data infrastructure, including pipelines, warehouses, and processing platforms. This includes developing automation scripts to streamline operations and ensure scalability for growing data volumes.
Monitoring & Incident Response: Implement robust monitoring and alerting systems to proactively identify issues. You must respond to incidents promptly to minimize downtime and data loss.
Quality & Optimization: Measure and monitor data quality. Optimize systems to reduce latency, improve performance, and ensure effective processing.
Collaboration: Work with data scientists, domain owners, and infrastructure teams to ensure effective data consumption, forecast growth, and plan capacity.
Security & Compliance: Ensure data security and compliance with protection regulations by implementing access controls and encryption.
Documentation: Maintain clear, up-to-date documentation for systems,
configurations, and standard operating procedures.
Qualifications:
Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related field.
Experience: 5+ years of experience in data engineering or data science on GCP.
Proven experience as a Data SRE or similar role focused on infrastructure management.
Solid understanding of SRE practices and software development best practices (Git, CI/CD).
Technical Proficiency:
GCP Services: BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, and Google Cloud Storage.
Programming: Robust skills in Python (NumPy, Pandas, PySpark), Java (Spark, functional interfaces), or Scala.
Data Tools: Relational databases, data warehousing, big data platforms, and data streaming (e.g., Kafka).
Monitoring: Experience with Cloud Logging, ELK Stack, AppDynamics, Current Relic, or Splunk.
P
📌 Data Reliability Engineer Iii Bengaluru
🏢 Chicago Mercantile Exchange
📍 Bengaluru