Seeking a Specialist with 5 to 7 years of experience in GCP BigQuery and Databricks to design develop and optimize scalable data solutions within the GCP Databricks ecosystem
Job Description
Design build and maintain scalable data pipelines and ETLELT processes using GCP BigQuery and Databricks Develop and optimize Databricks notebooks and jobs leveraging Apache Spark and PySpark for efficient data processing Implement data ingestion transformation and storage solutions using GCP native tools Ensure data quality validation and reconciliation across pipelines Collaborate with crossfunctional teams to align data solutions with business requirements Monitor and troubleshoot pipeline performance and optimize for scalability and reliability Maintain compliance with data governance security and best practices within cloud environments Stay current with emerging technologies and best practices in cloud data engineering and Databricks implementations
Roles and Responsibilities
Lead the design and implementation of data workflows and pipelines on GCP and Databricks platforms Develop and optimize Spark jobs notebooks and workflows for processing large enterprise datasets Apply data engineering best practices to enhance performance scalability and reliability of data solutions Collaborate with data scientists analysts and architects to support analytics AI and machine learning workflows Participate in code and design reviews to ensure highquality deliverables Support production data pipelines including monitoring incident resolution and continuous improvement Mentor and guide junior team members on technology evaluations design and implementation Integrate Databricks pipelines with upstream and downstream systems and cloud services
Skills
Mandatory Skills : Apache Airflow, Databricks, GCP BigQuery, Python - Data Science, Python for DATA
About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, recent productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
📌 Specialist - Data Engineering (Kolkata)
🏢 LTM
📍 Kolkata
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.