15 Oct
|
Accenture
|
Bengaluru
15 Oct
Accenture
Bengaluru
Project Role : Custom Software Engineer
Project Role Description : Design, build and configure applications to meet business process and application requirements.
Must have skills : Google Cloud Platform Architecture
Good to have skills : Google BigQuery
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education
Key Responsibilities
Data Pipeline Development
Design and implement robust, scalable batch and streaming data pipelines using Python and GCP services.
Build and maintain data transformation workflows in Dataform (SQLX) integrated with BigQuery.
Develop event-driven and real-time data processing solutions using Pub/Sub and Cloud Functions / Cloud Run.
Manage large-scale structured and unstructured data stored in GCS, BigQuery, and Cloud Spanner.
Python & Google SDK
Write clean, well-structured Python code leveraging GCP client libraries (google-cloud-bigquery, google-cloud-storage, google-cloud-pubsub, google-cloud-spanner, etc.).
Develop reusable Python modules, utilities, and SDKs for internal data platform tooling.
Ensure all code meets quality standards through thorough unit testing with pytest and code reviews.
Infrastructure & DevOps
Provision and manage GCP infrastructure using Terraform, following infrastructure-as-code (IaC) best practices.
Maintain CI/CD pipelines in GitLab for automated testing, linting, and deployment of data workloads.
Understanding of monitoring, alerting, and observability for data pipelines and GCP resources.
Manage containerised workloads on Cloud Run, including Dockerfiles and container registries.
Skills
5+ years of experience in data engineering with at least 2 years on GCP.
Solid Python programming skills — clean code, OOP, packaging, and performance optimization.
Hands-on experience with BigQuery: query optimization, partitioning, clustering, and data modelling.
Experience with Pub/Sub for event-driven architectures and streaming ingestion.
Proficiency in Cloud Run and/or Clo
📌 Custom Software Engineer (Bengaluru)
🏢 Accenture
📍 Bengaluru