Project description Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics. Responsibilities
- Web scraping using scripts/APIs/Tools
- Help build and maintain greenfield data platform running on Snowflake and AWS
- Understand the existing pipelines and enhance pipelines for the new requirements.
- Onboarding current data providers
- Data migration projects Skills Must have
- 10+ years of exp as Data Engineer
- SQL
- Python
- Linux
- Containerization(Docker, Kubernetes)
- AWS
- Strong on Dev ops side of things(K8s, Docker, Jenkins) Nice to have
- Market Data Projects/ Capital markets exp
- Snowflake is a big plus
- Airflow Other
- Languages: English: B2 Upper Intermediate
- Seniority: Senior Location - pune,mumbai,chennai,banagalore
📌 Data Ops/Engineer (Mumbai)
🏢 Luxoft
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.