19 Nov
|
Asm Jobs
|
Bengaluru
19 Nov
Asm Jobs
Bengaluru
Role & responsibilities:- Design, develop, and manage scalable data pipelines with automated data quality checks.- Own end-to-end data platform architecture across GCP, BigQuery, dbt, Airflow, and Python.- Implement data governance, lineage, metadata management, and lifecycle practices.- Develop and optimize BigQuery SQL procedures, ETL processes, and data workflows.- Build and maintain scalable data models, schemas, and data integration solutions.- Establish engineering standards, code reviews, testing strategies, and CI/CD practices.- Implement monitoring, logging, and alerting to ensure data quality and system reliability.- Optimize data performance, scalability, and high availability.- Mentor engineers and collaborate with cross-functional teams to drive technical solutions.- Drive data platform architecture, technology roadmap,
and continuous improvements.Preferred candidate profile:- 10+ years of experience in Data/ETL Engineering and Architecture, with 3+ years in a Senior/Lead role.- 3+ years of hands-on experience with GCP and BigQuery, including performance and cost optimization.- Solid expertise in SQL, dbt, Python, Apache Airflow/Composer.- Experience with GCP services such as BigQuery, Dataflow, and Dataproc.- Hands-on experience with ETL tools like Talend, Fivetran, or similar.- Strong knowledge of cloud data platforms, real-time data processing, and dimensional modelling.- Experience in data quality, governance, observability, CI/CD, and Infrastructure as Code.- Proven ability to lead architecture decisions, mentor engineers, and collaborate across teams.- Bachelor's degree in Computer Science or a related field. (ref:hirist.tech)
📌 Staff Data Engineer - GCP/BigQuery (Bengaluru)
🏢 Asm Jobs
📍 Bengaluru