09 Oct
|
OSI Digital
|
Hyderabad
09 Oct
OSI Digital
Hyderabad
Job Title: GCP Data Engineer / Solution Architect (Contract)
Engagement Type: Contract, part-time
Duration: 3 months (extension possible)
Experience: 8–10 years
Work Mode: Remote / work from home
Commitment: 20 hours per week
About The Role
We need a senior data professional on a short-term, part time contract. You'll combine hands-on data engineering on Google Cloud Platform with solution architecture and business analysis. You'll assess the current state, find gaps, design the target solution and write code where needed, working mostly on your own with our internal team and stakeholders.
Key Responsibilities
• Gather business and technical requirements through stakeholder workshops and turn them into solution designs.
• Do gap analysis between the current-state data landscape and the target-state requirements, then recommend remediation options and a roadmap.
• Define the solution architecture for data ingestion, processing, storage and consumption layers on GCP.
• Design and build scalable data pipelines using BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow),
Cloud Storage and Pub/Sub.
• Write production-quality code in Python, PySpark and SQL for data transformation, data quality checks and automation.
• Design data models (dimensional, data vault or lakehouse patterns) and optimize BigQuery performance and cost.
• Prepare architecture diagrams, design documents, gap analysis reports and handover documentation.
• Review code and designs, and advise the internal team on best practices for GCP data engineering.
• Report progress, risks and dependencies to project stakeholders regularly.
Required Skills & Qualifications
• 8–10 years of experience in data engineering, data platforms or analytics, with at least 4 years of hands-on work on GCP.
• Strong experience with GCP data services: BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, Pub/Sub, IAM.
• Expert-level Python and SQL, with solid hands-on experience in PySpark.
• Proven solution
📌 Senior Data Engineer (Hyderabad)
🏢 OSI Digital
📍 Hyderabad