Responsibilities
- Drive enterprise data architecture and data warehouse modernization initiatives, providing strategic vision and scalable pipeline solutions to support business requirements and Coupa's AI engine.
- Design, deploy, and maintain automated end-to-end ETL/ELT pipelines from the ground up across cloud data lakes and warehouses.
- Implement modern Data Mesh architectures and build transformation workflows utilizing Data Build Tool (DBT) and orchestration platforms such as Cloud Composer / Apache Airflow.
- Leverage AI/ML frameworks and spend data to power predictive analytics, recommendation platforms, and retail search services.
- Develop and maintain automated monitoring, logging, and alerting systems to ensure high data quality, availability, performance, and operational reliability.
- Ingest and consolidate data from diverse third-party APIs, legacy databases (SQL Server, Oracle), and platforms (Salesforce, Customer Data Platforms) into unified cloud data warehouses.
- Investigate and resolve complex data pipeline, data lineage, and query performance issues, providing technical expertise across teams.
- Collaborate with cross-functional engineering, analytics, and product teams across global time zones (US, Europe, India) to deliver data for business intelligence and Power BI reporting.
- Conduct regular data audits, assessments, and security governance to ensure compliance with enterprise policies and standards.
- Mentor and guide junior data engineers to cultivate a high-performing technical team.
- Flexible and adaptable to work across international time zones.
Requirements
- Bachelor's/Master's degree in Computer Engineering, Computer Science, or equivalent experience
- 5+ years of experience in data engineering, data warehouse modernization, and large-scale ETL development
- Expertise in cloud-native data platforms, with heavy specialization in GCP BigQuery and core cloud services (GCS, Cloud Functions, Dataflow)
- Advanced scripting and programming skills in Python and SQL for automation, data processing, and query optimization
- Proven hands-on expertise with transformation and orchestration tools like DBT and Apache Airflow / Cloud Composer
- Experience working with modern data platform concepts including Data Mesh, Customer Data Platforms (CDP), and Marketing Data Warehouses
- Robust foundation in cloud deployments with expertise in GCP, and AWS or Azure as a bonus
- Solid understanding of data security, backup/recovery, disaster recovery strategies, and operational performance tuning
- Excellent written and verbal communication skills with strong leadership and ownership capabilities
- Experience integrating data pipelines with business intelligence and data visualization platforms like Power BI
- Exposure to preparing e-commerce and spend datasets for AI Search and Recommendation API models
- Proficiency in version control systems like Git and basic exposure to infrastructure-as-code tools like Terraform
- Hands-on experience migrating legacy OLTP/on-premise databases (e.g., Oracle, SQL Server) to cloud environments
- Relevant certifications such as GCP Professional Data Engineer or AWS Certified Solutions Architect
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Sr Cloud Software Engineer (Pune)
🏢 Coupa
📍 Pune