18 Aug
|
ALESAYI HOLDING | العيسائي القابضة
|
Chennai
18 Aug
ALESAYI HOLDING | العيسائي القابضة
Chennai
**********NoteImmediate Joiner/Serving Notice Candidate only4 days office/1 day Must 7+ years of exp in Data Engineering**********Position DescriptionGCP Data Engineer to build cloud analytics platforms using lean Agile practices. You will design, modernize, and land data on the Google Cloud Platform (GCP) to support Enabling Platforms and Analytics. Experience with large-scale data warehouses, data lakes, and decentralized data architectures (like Data Mesh) on GCP is required. You will also design foundational data infrastructure to power enterprise AI, Machine Learning (ML), and Generative AI initiatives. We need candidates with a broad set of technology skills who can design optimal solutions using GCP and third-party technologies. You will: Implement Data Mesh principles (data as a product, data contracts, self-serve platforms). Design, build, and maintain high-performance dimensional data models (Star/Snowflake Schema) supporting BI, analytics, and AI/ML. Develop analytics data products using streaming and batch ingestion in GCP. Collaborate with Data Science/AI teams to architect MLOps pipelines and integrate Gen AI (LLMs, Vector Search). Act as SME in Data Engineering, AI integrations, and GCP services, advocating for technical excellence. Work in collaborative, agile environments (including pairing/mobbing) with cross-functional engineers, product owners, and data stewards. Primary Skills Required: Experience building domain-specific, secure "data products" within a Data Mesh framework. Expertise in dimensional modeling (Star/Snowflake Schema) and optimizing schemas for Big Query. Experience deploying automated, end-to-end data pipelines (concept to operations) with automated data lineage,
quality frameworks, and observability. Ability to evaluate, prototype (Po C), and productionalize GCP tools for ingestion, integration, and reporting. Skill in translating business problems into technical data requirements alongside product management and architects. Experience with data governance, cataloging, and access control (e.G., GCP Dataplex, GCP Data Catalog) in decentralized environments. Experience Required: In-depth understanding of GCP architecture. Hands of experience in data engineering and analytics application development. Hands-on experience with GCP services: Big Query, Dataflow, Dataform, Astronomer, Dataproc, Cloud Composer/Airflow, Cloud SQL, Compute Engine, Cloud Functions, Cloud Run, Artifact Registry, Cloud Build, Pub/Sub, and Dataplex, plus Apache Kafka. 5+ years of advanced SQL development and query optimization. 2+ years of development experience in Java or Python, and Apache Beam. 2+ years of building Tekton or similar CI/CD pipelines. Robust expertise in ETL/ELT pipelines, data cleaning, validation, and processing architecture.Skills Required:Big Query,, GCP, Cloud Composer, Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton, Cloud SQL, AIRFLOW, POSTGRES, Airflow Py Spark, Python, APISkills Preferred:Vertex,
AI/MLExperience Required:Engineer 3 Exp: 7+ years Data Engineering work experienceAdditional Information :- Experience building and productionalizing Machine Learning and Generative AI solutions using Vertex AI (including Gemini, Model Garden, Vector Search, and Vertex AI Pipelines), Tensor Flow, Big Query ML, and Auto ML.- Proficient in Machine Learning model architecture, data pipeline interaction, and metrics interpretation. This includes designing, deploying, and monitoring end-to-end MLOps pipelines, managing feature stores, and orchestrating pipelines for Generative AI (including Retrieval-Augmented Generation (RAG) and LLM orchestration).- Experience in building solution architecture, provisioning infrastructure (Ia C via Terraform), and securing reliable, compliant, data-centric services and applications in GCP.- Experience implementing data quality, lineage, and governance policies using Dataplex or other in a self-serve platform environment.- Experience with development ecosystems such as Git, Jenkins, and CI/CD.- Advanced experience with Analytics Engineering tools like DBT (Data Build Tool) or Dataform for modeling and transforming data within Big Query.- Experience working with Agile and Lean methodologies.- Team player and attention to detail.- Performance tuning experience (query optimization, partitioning, clustering, and cost management in Big Query).Education Required:- Bachelor’s degree in computer science or related scientific field.- IT or related associated topics: data architect, data center, data integrity, data manager, data management, data scientist, data warehousing, SQL, AI and ML.
📌 ( Bigdata(Pyspark) Engineer (Chennai)
🏢 ALESAYI HOLDING | العيسائي القابضة
📍 Chennai