Company Description Visa is a world leader in payments technology facilitating transactions between consumers merchants financial institutions and government entities across more than 200 countries and territories dedicated to uplifting everyone everywhere by being the best way to pay and be paid At Visa you ll have the opportunity to create impact at scale tackling meaningful challenges growing your skills and seeing your contributions impact lives around the world Join Visa and do work that matters to you to your community and to the world Progress starts with you CMS division s charter is to capture new sources of money movement through card and non-card flows including Visa Business Solutions Government Solutions and Visa Direct which presents an enormous growth opportunity Our team brings payment solutions and associated services to clients around the globe Our global clients and partners deploy our solutions to serve the needs of Small Businesses Middle Market Clients Large Corporate Clients Multi Nationals and Governments The Visa Business Solutions VBS and Visa Government Solutions VGS team is a world-class technology organization experiencing tremendous double-digit growth as we expand products into new payment flows and continue to grow our core card solutions This is an incredibly exciting team to join as we expand globally Essential Functions Strong technology and leadership background delivering enterprise-scale data and AI solutions using Scala Java Python Spring Boot REST gRPC APIs SQL NoSQL databases and modern UI frameworks such as Angular React Expertise with distributed systems cloud-native architectures and microservices is essential Deep experience in modern Data Engineering including Spark Structured Streaming Databricks Kafka Airflow DBT Delta Lake Apache Iceberg and large-scale ETL ELT pipelines across cloud platforms AWS GCP Azure Ability to design implement and operationalize data platforms pipeline frameworks using open-source and cloud-native technologies such as Hadoop ecosystem Spark Hive HBase Flink Kafka Kinesis BigQuery Snowflake Redshift GenAI and LLM engineering exposure including prompt engineering LLM fine tuning RAG Retrieval Augmented Generation vector databases Pinecone FAISS Weaviate Milvus and integration of foundation models OpenAI Anthropic Gemini Llama Experience building LLMOps pipelines model versioning deployment monitoring evaluation and reinforcement learning from human feedback RLHF workflows Champion Design Architecture and Coding best practices performing code reviews improving engineering quality and technically leading and mentoring a small team Hands-on experience with CI CD and DevOps MLOps tools such as Jenkins GitHub Actions GitLab CI Argo CD Terraform Docker Kubernetes Helm Artifactory Selenium and configuration tools like Chef Ansible Familiarity with machine learning data science and statistical modeling regression clustering decision trees time-series modeling and experience partnering with ML teams to productionize models Responsible for designing and building scalable secure cloud-based distributed systems and data platforms ensuring resiliency governance lineage and data quality using tools like Great Expectations Monte Carlo Collibra and Apache Atlas Experience managing global remote teams across different time zones and driving effective collaboration Partner closely with product managers to shape long-term vision capability strategy and roadmap aligned to business objectives Work collaboratively with senior engineers to establish architecture blueprints evaluate new technologies and define reusable components for new product development Enforce strong software engineering standards documentation testing coding conventions and ensure high-quality deliverables on demanding timelines Lead project planning prioritization stakeholder management delivery tracking and cross-functional communication Ensure operational excellence through monitoring observability Prometheus Grafana Recent Relic reliability engineering and production support best practices Identify opportunities for innovation process optimization automation and standardization across the data and AI ecosystem Mentor junior team members guide architectural decisions establish departmental best practices and engineering playbooks Participate in hiring developing and retaining world-class data ML and GenAI engineering talent Demonstrate strong stakeholder and negotiation skills acting as a trusted ambassador between engineering business units and executive leadership to balance strategic trade-offs This is a hybrid position Expectation of days in office will be confirmed by your hiring manager Qualifications Bachelor degree in a technical field such as computer science computer engineering or related field required Advanced degree preferred Requires 10 years of experience at least 3 of which were in leading engineering teams 6 years of hands-on experience in Hadoop using Core Java Programming Spark Scala Hive MongoDB Streaming Kafka and any ETL tool exposure Strong knowledge of Database concepts and UNIX Experience in handling very large data volume in low latency and or batch mode Proven experience delivering large scale highly available production software Ability to handle multiple competing priorities in a fast-paced environment A deep understanding of end-to-end software development in a team and a track record of shipping software on time Payment processing background desirable but not required Experience working in an Agile and Test-Driven Development environment Strong business and technical vision Outstanding verbal written presentation facilitation and interaction skills including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management Quick learner self-starter detailed and work with minimal supervision Additional Information Visa is an EEO Employer Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law

📌 Data Engineer - Sr Consultant Level (Karnataka)
🏢 Visa
📍 Karnataka