22 Nov
|
Infinite Computer Solutions
|
Bengaluru
22 Nov
Infinite Computer Solutions
Bengaluru
Key Responsibilities
• Define end-to-end data architecture and technology strategy for enterprise-scale GCP data platforms.
• Design cloud-native data solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and related GCP services.
• Establish architectural patterns for batch ingestion, real-time streaming, data transformation, and analytics.
• Define data modeling strategies, including conceptual, logical, and physical data models.
• Design scalable data warehousing and lakehouse-style architectures based on business and technical requirements.
• Drive architecture decisions around performance, availability, scalability, disaster recovery, and cost optimization.
• Establish standards for data quality, metadata management, data lineage, security, governance, and regulatory compliance.
• Guide engineering teams on architecture implementation, code quality, design patterns, and technology selection.
• Evaluate emerging GCP services and recommend appropriate tools and frameworks.
• Collaborate with business leaders, enterprise architects, security teams,
and engineering stakeholders to translate business objectives into architecture blueprints.
• Review solution designs, identify architectural risks, and ensure alignment with enterprise architecture principles.
• Drive cloud modernization, platform optimization, and data engineering best practices. Required Skills
• 12-15 years of experience in data engineering, data architecture, cloud platforms, or related technology domains.
• Hands-on experience with GCP (BigQuery, Composer, Dataproc, Dataflow, Pub/Sub)
• Working knowledge of Databricks for data processing and pipelinesStrong programming skills in SQL and PySpark
• Experience with Oracle and SQL Server databases
• Understanding of data modelling (dimensional / medallion basics)
• Experience in batch pipelines and exposure to streamingFamiliarity with data ingestion, ETL/ELT processes
• Basic understanding of data quality and validationExposure to Airflow/Composer and scheduling
• Working knowledge of Git and CI/CD (ref:hirist.tech)
📌 Infinite Computer Solutions (Bengaluru)
🏢 Infinite Computer Solutions
📍 Bengaluru