Project description
Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.
Responsibilities
Web scraping using scripts/APIs/Tools
Help build and maintain greenfield data platform running on Snowflake and AWS
Understand the existing pipelines and enhance pipelines for the recent requirements.
Onboarding current data providers
Data migration projects
Skills
Must have
10+ years of exp as Data Engineer
SQL
Python
Linux
Containerization(Docker, Kubernetes)
AWS
Solid on Dev ops side of things(K8s, Docker, Jenkins)
Nice to have
Market Data Projects/ Capital markets exp
Snowflake is a big plus
Airflow
Other
Languages: English: B2 Upper Intermediate
Seniority: Senior
Location - pune,mumbai,chennai,banagalore
📌 Data Ops/engineer Market Data Projects Mumbai (India)
🏢 Luxoft
📍 India