15 Oct
|
Philodesign Technologies
|
India
15 Oct
Philodesign Technologies
India
Data Platform Engineer (GCP / BigQuery)
Location: Remote/Hybrid
Experience: 3-6 Years
Employment Type: Contract
Department: Data Engineering / Data Platform
Reports To: Data Platform Manager
Job Summary
We are seeking a skilled Data Platform Engineer (GCP/BigQuery) to manage, optimize, and support our cloud-based data platform. The ideal candidate will have strong expertise in Google Cloud Platform (GCP), BigQuery, Dataplex, data governance, ELT pipeline operations, and cloud security. This role will be responsible for ensuring data reliability, platform performance, cost optimization, access management, and operational excellence across the data ecosystem.
Key Responsibilities
Data Platform Administration
- Administer and manage BigQuery environments, datasets, projects, service accounts, and IAM permissions.
- Monitor and optimize BigQuery performance, storage, and query costs.
- Manage user access lifecycle including onboarding, modifications, and offboarding.
- Implement and maintain BigQuery best practices for scalability and performance.
ELT Pipeline Monitoring & Support
- Monitor data ingestion pipelines and troubleshoot failures, delays, and data quality issues.
- Ensure end-to-end data reliability from source systems to BigQuery.
- Identify and resolve data freshness, completeness, and schema drift issues.
- Collaborate with data engineering teams to improve pipeline performance and stability.
Data Governance & Security
- Manage Dataplex policy tags, data classifications, and sensitive data controls.
- Implement column-level security, masking policies, and fine-grained access controls.
- Ensure compliance with organizational security policies and data governance standards.
- Conduct periodic access reviews and audits.
Performance Optimization
- Optimize BigQuery workloads through partitioning, clustering, query tuning, and cost management techniques.
- Evaluate and recommend new GCP and BigQuery features.
- Monitor platform utilization and implement improvements for efficiency and scalability.
Incident Management & Operational Excellence
- Act as a primary point of contact for platform incidents and operational issues.
- Perform root cause analysis and implement long-term fixes.
- Create and maintain technical documentation, SOPs, runbooks, and recovery procedures.
- Support monitoring, alerting, and platform observability initiatives.
Required Skills & Qualifications
Technical Skills
- Robust hands-on experience with Google Cloud Platform (GCP).
- Expertise in BigQuery Administration and Optimization.
- Experience with Dataplex, Data Governance, and access control management.
- Strong knowledge of IAM, Service Accounts, and Cloud Security.
- Advanced SQL skills.
- Experience supporting ELT/ETL platforms such as:
- Fivetran
- Airbyte
- CData
- Similar Data Integration Tools
- Experience with Python and/or Bash scripting for automation.
- Understanding of data warehousing concepts and data modeling fundamentals.
Professional Experience
- 3-5+ years of experience in:
- Data Engineering
- Data Platform Engineering
- Cloud Platform Operations
- Experience in production support, monitoring, and incident management.
- Experience working with regulated or sensitive data environments.
Preferred Qualifications
- Experience with dbt.
- Familiarity with Tableau or other BI tools.
- Experience supporting Salesforce, NetSuite, or enterprise business systems.
- Experience in SaaS or cloud-native environments.
- Google Cloud certifications such as:
- Professional Data Engineer
- Professional Cloud Architect
Key Competencies
- Problem-solving and troubleshooting
- Data Governance & Security
- Cost Optimization
- Stakeholder Collaboration
- Documentation & Process Management
- Analytical Thinking
- Communication Skills
- Operational Excellence
Nice-to-Have Technologies GCP, BigQuery, Dataplex, Fivetran, Airbyte, dbt, Python, Bash, SQL, Tableau, IAM, Data Governance, Data Warehousing, Cloud Security.
📌 Data Platform Engineer (India)
🏢 Philodesign Technologies
📍 India