Design and implement complex data pipelines using Dataflow Apache Beam and Dataproc Spark
Lead Cloud Composer Airflow orchestration design optimizing DAG structure dependencies and retry strategies
Drive advanced Python and SQL implementations including reusable frameworks and utility components
Build and standardize custom Dataflow Beam templates and reusable pipeline patterns
Perform deep performance tuning for BigQuery query optimization partitioning strategies cost optimization
Troubleshoot complex pipeline failures and performance bottlenecks across processing and orchestration layers
Review code and design artifacts produced by engineers provide technical guidance and mentoring
Own technical quality for assigned modules including nonfunctional aspects performance reliability scalability
Act as the first point of escalation for technical issues before involving architects
Collaborate with architects to understand design intent and ensure correct implementation
Mandatory Technical Skills
Advanced GCP Knowledge
Strong understanding of IAM strategy service isolation and projectlevel design considerations
Programming Querying
Advanced proficiency in Python and complex GoogleSQL
Orchestration
Strong handson expertise with Cloud Composer Airflow including best practices and optimization
Data Processing
Deep handson experience with Dataflow and Apache Beam
Strong working knowledge of Dataproc Spark internals
Analytics Platform
Advanced experience with BigQuery including performance and cost optimization techniques
Good to Have
Exposure to streaming data pipelines and PubSubbased ingestion
Familiarity with CICD Gitbased version control and basic DevOps practices
Understanding of data quality checks logging and monitoring patterns
Exposure to AgileScrum delivery models
GCP certifications such as Associate Cloud Engineer or Professional Data Engineer nice to have
Skills
Mandatory Skills : GCP BigQuery, GCP Storage, Python for DATA
About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling current ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
📌 Specialist - Data Engineering (Kolkata)
🏢 LTM
📍 Kolkata
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.