Senior Data Engineer - Vice President - Python Development (Pune)

Senior Data Engineer - Vice President - Python Development (Pune)

01 Aug
|
Citigroup
|
Pune

01 Aug

Citigroup

Pune

Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of approximately 219,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewTechnologyJoin a small, high-impact engineering team in Citi Markets Technology building the data foundation for greenfield Generative AI products across asset classes. We are looking for an experienced Data Engineer who combines deep Python expertise with strong engineering judgement and a practical understanding of how to build reliable, high-performance data platforms.The role goes beyond constructing ETL pipelines. You will help define how billions of records from diverse Markets data sources are collected, validated, transformed, governed, and made available to production AI applications with consistently low retrieval latency.If you want to work on ambitious data engineering problems, shape a platform from the ground up, and help define how data is engineered for production AI in Markets, this is the role for you.The TeamWe are a rapid-moving team specialising in Generative AI within Markets Technology. We build greenfield products that span multiple asset classes and solve real business problems using modern AI and data engineering approaches.Our applications depend on a robust and well-designed data foundation. That means creating pipelines and serving layers that can process billions of records while preserving data quality, provenance, security, and operational reliability.The team is still small enough for every engineer to have genuine influence. Data engineering is a core part of the product architecture, not a downstream support function.The RoleAs a Vice President in the team, you will be a hands-on senior engineer responsible for designing and building the data foundation for greenfield Generative AI products across Markets, including our conversational AI platform.You will develop production-grade data pipelines and services, primarily using Python, to ingest, validate, transform, enrich, and serve data from a wide range of internal and external sources. You will help create a curated, high-performance data-serving layer that enables low-latency retrieval by our AI and application services.You will contribute directly to code while also shaping architecture, engineering standards, data models, quality controls, and operational practices. We are looking for someone who can make pragmatic technology choices, challenge assumptions, and take long-term ownership of the platform.What You’ll DoDesign, build, and evolve the data architecture supporting Generative AI products across MarketsDevelop scalable Python pipelines that ingest, validate, transform, enrich, and integrate billions of records from diverse sourcesBuild curated,



queryable datasets and high-performance serving layers for low-latency application accessDesign and optimise the application’s data storage strategies, initially centred on PostgreSQL and ParquetSelect suitable processing approaches for each workload, from efficient in-process and columnar processing to distributed frameworks where requiredOptimise ingestion, transformation, storage, indexing, and query performanceEstablish robust controls for data quality, reconciliation, lineage, schema evolution, idempotency, and recoveryBuild production observability into data pipelines, including metrics, logging, alerting, and operational diagnosticsDesign solutions that respect data classification, entitlements, access controls, and security requirementsContribute directly to code, architecture reviews, technical standards, and the wider engineering direction of the teamBuild automated tests and CI/CD pipelines that enable reliable and repeatable deliveryCollaborate closely with AI engineers, software engineers, architects, product partners, and Markets stakeholdersUse AI-assisted engineering tools, including Devin and GitHub Copilot, to improve development quality and productivityWhat We’re Looking ForExtensive hands-on experience in data engineering, software engineering, or a closely related disciplineDeep practical expertise in Python and the ability to build maintainable, production-grade softwareA proven track record of designing and delivering large-scale data platforms or data-intensive applicationsStrong SQL skills and extensive experience with relational databases, particularly PostgreSQLExperience with data modelling, indexing, partitioning, query optimisation, and database performance tuningStrong knowledge of the Python data ecosystem, including libraries such as pandas, PyArrow, SQLAlchemy, and NumPyPractical experience working with columnar formats such as Apache Parquet and selecting efficient storage and serialisation strategiesExperience processing large-scale datasets using technologies such as Apache Spark, Dask, Polars, or equivalent frameworksStrong understanding of ETL and ELT architecture, including incremental processing, idempotency, failure recovery, and schema evolutionExperience implementing automated data quality controls, reconciliation, lineage, monitoring, and operational alertingStrong software engineering fundamentals, including design, testing, maintainability, code review,



and CI/CDExperience deploying and operating services on container platforms such as Kubernetes or OpenShiftUnderstanding of data governance and security practices, including encryption, masking, classification, entitlements, and fine-grained access controlThe ability to operate in ambiguity, take ownership, and influence the technical direction of a productStrong communication skills and a collaborative approach to engineeringWhat Makes This Role DifferentThis is not a role focused on maintaining legacy ETL jobs or moving data between systems without understanding how it will be used.You will help build the data foundation of a new generation of AI products in Markets. The engineering challenges include integrating complex datasets, processing billions of records, delivering consistently low retrieval latency, and meeting the quality, security, and reliability standards expected of production financial systems.The role offers the opportunity to influence the architecture from an early stage, work closely with AI and application engineers, and take genuine ownership of a platform that is central to the product.Preferred ExperienceExperience with workflow orchestration technologies such as Apache Airflow, Dagster, or PrefectFamiliarity with Generative AI applications, retrieval architectures, LLMs, agentic systems, or structured evaluationExperience building data foundations for search, retrieval, analytics, machine learning, or AI applicationsKnowledge of financial instruments, trading concepts, and data structures within FX, Equities, or other capital markets domainsExperience working with temporal, reference, market, or transactional dataA bachelor’s or master’s degree in Computer Science, Engineering, or another relevant quantitative discipline, or equivalent professional experience------------------------------------------------------Job Family Group: Technology------------------------------------------------------Job Family:Applications Development------------------------------------------------------Time Type:Full time------------------------------------------------------Most Relevant Skills Please see the requirements listed above.------------------------------------------------------Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi( opens in new window).View Citi’s EEO Policy Statement( opens in new window) and the Know Your Rights( opens in new window) poster.

📌 Senior Data Engineer - Vice President - Python Development (Pune)
🏢 Citigroup
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer - vice president - python development (pune) / pune

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer - vice president - python development (pune) / pune